Downloads · 30 days
227
0% of all-time downloads
Qwen3.5-35B-A3B-NVFP4
apolo13x/Qwen3.5-35B-A3B-NVFP4
Qwen3.5-35B-A3B-NVFP4 is a image-text-to-text model from apolo13x. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This is a quantized version of Qwen/Qwen3.5-35B-A3B. This model accepts text and images as inputs and generates text as outputs. The weights and activations were quantized to FP4 using llm-compressor, reducing the mod…
All-time downloads
110K
Public
Repo size
23.4 GB
Likes
16
Public
Repo makeup
Click a slice to open those files.
.safetensors23.4 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3_5_moe
- Access
- Public
- Created
- Feb 25, 2026
- Updated
- Feb 27, 2026
- SHA
- 8dc7106f
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-35B-A3B-NVFP4
This is a quantized version of Qwen/Qwen3.5-35B-A3B. This model accepts text and images as inputs and generates text as outputs. The weights and activations were quantized to FP4 using llm-compressor, reducing the model size from 67.0 GB to 21.8 GB (~3.1x reduction) while maintaining 98.8% average accuracy recovery.
Inference
As of 2/27/2026, this model is supported in vLLM nightly. To serve the model:
vllm serve Kbenkhaled/Qwen3.5-35B-A3B-NVFP4 \
--reasoning-parser qwen3 \
--enable-prefix-caching
Evaluation
Evaluated with lm-evaluation-harness, 0-shot, thinking mode ON.
| Benchmark | Qwen3.5-35B-A3B | Qwen3.5-35B-A3B-NVFP4 (this model) | Recovery |
|---|---|---|---|
| GPQA Diamond | 81.31% | 80.81% | 99.4% |
| IFEval | 95.56% | 92.93% | 97.2% |
| MMLU-Redux | 92.51% | 92.31% | 99.8% |
| Average | 89.79% | 88.68% | 98.8% |
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_5_moe
- License
- apache-2.0
- Created
- Feb 25, 2026
- Updated
- Feb 27, 2026