Downloads · 30 days
0
0% of all-time downloads
Smaug-72B-exl2
turboderp/Smaug-72B-exl2
Smaug-72B-exl2 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
19
Public
Repo size
140 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.json4.5 MB · 100%
At a glance
- Access
- Public
- Created
- Feb 16, 2024
- Updated
- Feb 16, 2024
- SHA
- ffe529e8
Model card
From the Hugging Face model README
EXL2 quants of Smaug-72B-v0.1.
Couldn't find a description of the prompt format, but it looks like OpenChat?
2.50 bits per weight (may be a little broken?)
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
- Created
- Feb 16, 2024
- Updated
- Feb 16, 2024