Downloads · 30 days
21
6% of all-time downloads
m233zhan/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M
Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M is a text generation model from m233zhan. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repository provides a Q4KM GGUF quantization derived from:
Downloads · 30 days
21
6% of all-time downloads
All-time downloads
381
Public
Repo size
24.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf24.2 GB · 100%
From the Hugging Face model README
This repository provides a Q4_K_M GGUF quantization derived from:
markmonger/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-iMatrix-MTP-GGUF
The source repository provides the MTP GGUF model as q8_0-v1.gguf and is licensed under Apache-2.0.
| File | Quantization | SHA256 |
|---|---|---|
q4_k_m-v1.gguf | Q4_K_M | c9791ad1fda0c2cb0290c268c035d888121e3d5e84a9e6f0a6b34618cc081d90 |
With llama.cpp:
llama-cli -hf m233zhan/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M:q4_k_m-v1.gguf
Or start an OpenAI-compatible local server:
llama-server -hf m233zhan/Qwen3.6-40B-Heretic-MTP-GGUF-Q4_K_M:q4_k_m-v1.gguf
Model lineage shown by the upstream repository:
Qwen/Qwen3.6-27BDavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinkingmarkmonger/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-iMatrix-MTP-GGUFThis repository only adds the Q4_K_M GGUF quantization.