Downloads · 30 days
57
16% of all-time downloads
NINI26454/Huihui-Qwen3.6-27B-abliterated-MTP-Q3_K-GGUF
Huihui-Qwen3.6-27B-abliterated-MTP-Q3_K-GGUF is a machine learning model from NINI26454. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
3-bit GGUF quantization of huihui-ai/Huihui-Qwen3.6-27B-abliterated.
Downloads · 30 days
57
16% of all-time downloads
All-time downloads
350
Public
Repo size
14.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf14.4 GB · 100%
From the Hugging Face model README
3-bit GGUF quantization of huihui-ai/Huihui-Qwen3.6-27B-abliterated.
Huihui-Qwen3.6-27B-abliterated-ggml-model-Q3_K.gguf (3-bit quantization, 13.5 GB)mmproj-model-f16.gguf (Multimodal vision projector, 927 MB)Modelfile (Ready-to-use Ollama Modelfile).gguf file and Modelfile in the same directory.ollama create qwen3.6-27b-abliterated -f Modelfile
ollama run qwen3.6-27b-abliterated
llama-cli -m Huihui-Qwen3.6-27B-abliterated-ggml-model-Q3_K.gguf --mmproj mmproj-model-f16.gguf -p "Hello!"
EOF rm -rf /teamspace/studios/this_studio/models/export_qwen36_q3/.cache ls -lh /teamspace/studios/this_studio/models/export_qwen36_q3/