Downloads · 30 days
13
3% of all-time downloads
turboderp/TinyLlama-1B-exl2
TinyLlama-1B-exl2 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
13
3% of all-time downloads
All-time downloads
385
Public
Repo size
12.2 GB
Likes
7
Public
Click a slice to open those files.
.json1.2 MB · 100%
From the Hugging Face model README
EXL2 quants of TinyLlama-1B (1.1B)
These are conversions of the 3T checkpoint at step 1431k
2.30 bits per weight
2.40 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight