Downloads · 30 days
62
3% of all-time downloads
FreedomAISVR/Qwen3.6-35B-A3B-Claude-4.7-Distill-NVFP4-GGUF
Qwen3.6-35B-A3B-Claude-4.7-Distill-NVFP4-GGUF is a text generation model from FreedomAISVR. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantization of lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled — a 35B MoE (3B active) reasoning model distilled from Claude 4.7 Opus.
Downloads · 30 days
62
3% of all-time downloads
All-time downloads
1.9K
Public
Repo size
20.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf20.2 GB · 100%
From the Hugging Face model README
GGUF quantization of lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled — a 35B MoE (3B active) reasoning model distilled from Claude 4.7 Opus.
| File | Type | Size | BPW |
|---|---|---|---|
qwen36-35b-distill-nvfp4.gguf | NVFP4 (all tensors) | ~18.81 GB | 4.55 |
All weight tensors quantized to NVFP4 (4-bit floating point). F32/F16 bias and norm tensors kept at original precision.
./llama-server -m qwen36-35b-distill-nvfp4.gguf --host 0.0.0.0 --port 8080