Downloads · 30 days
1.1K
2% of all-time downloads
cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF
Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF is a image-text-to-text model from cesarsal1nas. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as apache-2.0.
- This model has been tested by myself in Hermes Agent, it does everything it is supposed to, text, coding, vision, thinking, tools usage, everything works perfectly well so far there. I have also found that this very…
Downloads · 30 days
1.1K
2% of all-time downloads
All-time downloads
44.5K
Public
Repo size
22.1 GB
Likes
12
Public
Click a slice to open those files.
.gguf22.1 GB · 100%
From the Hugging Face model README
This is a Q4_K_M GGUF quantization of huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated.
Refer to the original model card for full details, usage warnings, and licensing information.
This is a Qwen3.5-35B-A3B MoE model that has been:
preprocessor_config.json, video_preprocessor_config.json); an mmproj file can be generated from the source safetensors for multimodal use| File | Size | Description |
|---|---|---|
Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf | ~20 GB | Main text model (Q4_K_M) |
Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mmproj-F16.gguf | ~858 MB | Vision projector for image input |
| Source model | huihui-ai/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated |
| Architecture | qwen35moe (35B total params, ~3B active; 256 experts, 8 active per token) |
| Quantization | Q4_K_M (~4.88 BPW) |
| File size | ~20 GB + 858 MB mmproj |
| Quantized with | llama.cpp b8352 |
| Context length | 262,144 tokens (trained) |
llama-cli \
--hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \
--hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
-p "Tell me about the universe"
llama-server \
--hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \
--hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
-c 131072
llama-server \
--hf-repo cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF \
--hf-file Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M.gguf \
--mmproj Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mmproj-F16.gguf \
-c 131072
ollama run hf.co/cesarsal1nas/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-Q4_K_M-GGUF