Downloads · 30 days
0
0% of all-time downloads
turboderp/Sheared-Llama2-2.7B-exl2
Sheared-Llama2-2.7B-exl2 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
EXL2 quants of Sheared-LLaMA-2.7B from princeton-nlp. This is a pruned and further pre-trained version of Llama2-7B
Downloads · 30 days
0
0% of all-time downloads
All-time downloads
12
Public
Repo size
23.5 GB
Likes
0
Public
Click a slice to open those files.
.json1.8 MB · 100%
From the Hugging Face model README
EXL2 quants of Sheared-LLaMA-2.7B from princeton-nlp. This is a pruned and further pre-trained version of Llama2-7B
2.50 bits per weight
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight