Downloads · 30 days
15
29% of all-time downloads
turboderp/nanochat-d34-exl3
nanochat-d34-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Downloads · 30 days
15
29% of all-time downloads
All-time downloads
51
Public
Repo size
6.8 GB
Likes
2
Public
Click a slice to open those files.
Other1.5 KB · 67%
From the Hugging Face model README
EXL3 quants of nanochat-d34
⚠️ Requires ExLlamaV3 v0.0.19 (or v0.0.18 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight