Downloads · 30 days
231
10% of all-time downloads
FreedomAISVR/Qwen3.6-35B-A3B-Claude-4.7-Distill-MXFP4-MOE-GGUF
Qwen3.6-35B-A3B-Claude-4.7-Distill-MXFP4-MOE-GGUF is a text generation model from FreedomAISVR. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantization of lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled — a 35B MoE (3B active) reasoning model distilled from Claude 4.7 Opus.
Downloads · 30 days
231
10% of all-time downloads
All-time downloads
2.3K
Public
Repo size
40.5 GB
Likes
1
Public
Click a slice to open those files.
.gguf20.3 GB · 100%
From the Hugging Face model README
GGUF quantization of lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled — a 35B MoE (3B active) reasoning model distilled from Claude 4.7 Opus.
| File | Type | Size | BPW |
|---|---|---|---|
qwen36-35b-distill-mxfp4_moe.gguf | MXFP4 (experts) + Q8_0 (non-experts) | ~18.87 GB | 4.56 |
MoE expert weights quantized to MXFP4. Non-expert weights (attention, shared experts, norms) quantized to Q8_0. Router weights kept at F32.
./llama-server -m qwen36-35b-distill-mxfp4_moe.gguf --host 0.0.0.0 --port 8080