Downloads · 30 days
67
15% of all-time downloads
turboderp/Qwen3-Next-80B-A3B-Thinking-exl3
Qwen3-Next-80B-A3B-Thinking-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
EXL3 quants of Qwen3-Next-80B-A3B-Thinking
Downloads · 30 days
67
15% of all-time downloads
All-time downloads
445
Public
Repo size
433 GB
Likes
7
Public
Click a slice to open those files.
.md1.7 KB · 53%
From the Hugging Face model README
EXL3 quants of Qwen3-Next-80B-A3B-Thinking
⚠️ Requires ExLlamaV3 v0.0.7 (or v0.0.6 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
Optimized:
2.08 bits per weight
2.27 bits per weight
2.78 bits per weight
3.14 bits per weight
3.53 bits per weight
4.06 bits per weight
4.51 bits per weight
