Downloads · 30 days
78
11% of all-time downloads
turboderp/Qwen3-Next-80B-A3B-Instruct-exl3
Qwen3-Next-80B-A3B-Instruct-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
EXL3 quants of Qwen3-Next-80B-A3B-Instruct
Downloads · 30 days
78
11% of all-time downloads
All-time downloads
726
Public
Repo size
372 GB
Likes
27
Public
Click a slice to open those files.
.md1.6 KB · 52%
From the Hugging Face model README
EXL3 quants of Qwen3-Next-80B-A3B-Instruct
⚠️ Requires ExLlamaV3 v0.0.7 (or v0.0.6 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
Optimized:
2.08 bits per weight
2.27 bits per weight
2.78 bits per weight
3.14 bits per weight
3.53 bits per weight
4.06 bits per weight
4.51 bits per weight
