← Catalog
BERT
AvailableGoogle DeepMindOpen source
The bidirectional encoder that reshaped NLP and seeded the transformer era.
Specifications
- License
- Open source · Apache-2.0
- Weights
- Downloadable
- Architecture
- Dense
- Parameters
- 0.34B
- Context window
- 512 tokens
- Max output
- —
- Knowledge cutoff
- Mar 31, 2018
- Price (in / out, $/M)
- —
- Modalities
- Text
Benchmarks
No benchmark scores recorded yet. Spotted some? Submit a correction.
Vendor-reported figures are claims until independently verified. See methodology.