β Catalog
TinyLlama v1.1
AvailableTinyLlamaOpen source
TinyLlama_v1.1 is the general-purpose 1.1B text-generation model in the TinyLlama v1.1 family, released as open weights on Hugging Face under Apache 2.0. It uses the Llama 2 architecture and tokenizer, with a 2048-token context. After a 1.5T-token SlimPajama pretrain, the team continued pretraining and published three specialized v1.1 variants; this is the standard general-purpose one. Distinct from the earlier TinyLlama 1.1B Chat v1.0 already in the catalog. Hugging Face created the model repo on 2024-03-09; the card itself does not print a release date.
Specifications
- License
- Open source Β· Apache-2.0
- Weights
- Downloadable
- Architecture
- Dense
- Parameters
- 1.1B
- Context window
- 2K tokens
- Max output
- β
- Knowledge cutoff
- β
- Price (in / out, $/M)
- β
- Modalities
- Text
Benchmarks
No benchmark scores recorded yet. Spotted some? Submit a correction.
Vendor-reported figures are claims until independently verified. See methodology.