Downloads · 30 days
13.5K
6% of all-time downloads
KevinJK51/Qwen3.6-12B-IQ-Ultra-Heretic-Uncensored-Thinking-V2-Hightop-GGUF
Qwen3.6-12B-IQ-Ultra-Heretic-Uncensored-Thinking-V2-Hightop-GGUF is a text generation model from KevinJK51. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantizations of DavidAU/Qwen3.6-12B-IQ-Ultra-Heretic-Uncensored-Thinking-V2-Hightop.
Downloads · 30 days
13.5K
6% of all-time downloads
All-time downloads
211K
Public
Repo size
116 GB
Likes
127
Trending 2
Click a slice to open those files.
.gguf116 GB · 100%
From the Hugging Face model README
GGUF quantizations of DavidAU/Qwen3.6-12B-IQ-Ultra-Heretic-Uncensored-Thinking-V2-Hightop.
Converted and quantized using llama.cpp b9192.
| Quant | Size | Quality |
|---|---|---|
| Q8_0 | 11.57 GB | Near-perfect |
| Q6_K | 8.93 GB | Excellent |
| Q5_K_M | 7.84 GB | Very good |
| Q5_K_S | 7.65 GB | Very good |
| Q5_0 | 7.65 GB | Good |
| Q4_K_M | 6.82 GB | Best balance |
| IQ4_NL | 6.58 GB | Very good (IQ) |
| Q4_K_S | 6.49 GB | Good |
| Q4_0 | 6.43 GB | Good |
| IQ4_XS | 6.31 GB | Good (IQ) |
| Q3_K_L | 5.94 GB | Acceptable |
| Q3_K_M | 5.58 GB | Acceptable |
| IQ3_M | 5.33 GB | Acceptable (IQ) |
| IQ3_S | 5.27 GB | Acceptable (IQ) |
| Q3_K_S | 5.15 GB | Fair |
| Q2_K | 4.60 GB | Minimal usable |
DavidAU/Qwen3.6-12B-IQ-Ultra-Heretic-Uncensored-Thinking-V2-Hightop
Use with LM Studio, llama.cpp, Ollama, or any GGUF-compatible inference engine.