Downloads · 30 days
127
1% of all-time downloads
juanml82/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-gguf
Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-gguf is a machine learning model from juanml82. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF quants for Huihui-Qwen3-Next-80B-A3B-Thinking-abliterated
Downloads · 30 days
127
1% of all-time downloads
All-time downloads
8.6K
Public
Repo size
144 GB
Likes
0
Public
Click a slice to open those files.
.gguf144 GB · 100%
From the Hugging Face model README
GGUF quants for Huihui-Qwen3-Next-80B-A3B-Thinking-abliterated
I've recreated them after the late December 2025 llama.cpp update which speeds up Qwen 3 Next, so these quants should perform better than the early quants for this model. I've uploaded three quants:
iQ3_M – should fit (tight) in systems with 32gb of ram plus an 8-12gb gpu with ram offloading. Possibly lowest useful quant.
MXFP4_MOE – should work for systems with 32gb of ram plus a 16gb or more gpu.
Q6K – will work well with systems with 64gb of ram plus ram offloading. Quality is supposed to very almost indistinguishable from Q8
Enjoy!