Downloads · 30 days
0
0% of all-time downloads
turboderp/Sheared-Llama2-1.3B-exl2
Sheared-Llama2-1.3B-exl2 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
EXL2 quants of Sheared-LLaMA-1.3B from princeton-nlp. This is a pruned and further pre-trained version of Llama2-7B
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
11
Public
Repo size
12.4 GB
Likes
0
Public
Click a slice to open those files.
.json1.3 MB · 100%
From the Hugging Face model README
EXL2 quants of Sheared-LLaMA-1.3B from princeton-nlp. This is a pruned and further pre-trained version of Llama2-7B
2.50 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight