Downloads · 30 days
9
0% of all-time downloads
Qwopus3.6-27B-v2-Q4_K_M-GGUF
zaydiscold/Qwopus3.6-27B-v2-Q4_K_M-GGUF
Qwopus3.6-27B-v2-Q4_K_M-GGUF is a machine learning model from zaydiscold. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as apache-2.0.
Q4KM quantization of Jackrong/Qwopus3.6-27B-v2 via stock llama.cpp (ggml-org/llama.cpp), built locally with Metal support on Apple Silicon.
All-time downloads
3.3K
Public
Repo size
16.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf16.8 GB · 100%
At a glance
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- May 23, 2026
- Updated
- May 23, 2026
- SHA
- 5bd7432f
Base models
Model card
From the Hugging Face model README
Qwopus3.6-27B-v2 Q4_K_M GGUF
Q4_K_M quantization of Jackrong/Qwopus3.6-27B-v2 via stock llama.cpp (ggml-org/llama.cpp), built locally with Metal support on Apple Silicon.
Preserves the MTP draft heads from the source — usable with speculative-decoding-enabled llama.cpp builds.
Use
# llama.cpp / Ollama / LM Studio / koboldcpp — any stock-llama.cpp consumer
llama-cli -m Qwopus3.6-27B-v2-Q4_K_M.gguf -p "Hi"
Author's temperature recommendation: 0.75–1.0.
Credits
- Source:
Jackrong/Qwopus3.6-27B-v2by Jackrong - GGUF conversion by zaydiscold
Mix brought by the NOTORIOUS MLX.
- Library
- gguf
- License
- apache-2.0
- Languages
- en, zh, ja, ko, es, ru
- Created
- May 23, 2026
- Updated
- May 23, 2026