Downloads · 30 days
23
6% of all-time downloads
Qwen3.5-35B-A3B-NVFP4-MTP
aastalll/Qwen3.5-35B-A3B-NVFP4-MTP
Qwen3.5-35B-A3B-NVFP4-MTP is a image-text-to-text model from aastalll. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This is a quantized version of Qwen/Qwen3.5-35B-A3B. This model accepts text and images as inputs and generates text as outputs. The weights and activations were quantized to FP4 using llm-compressor, reducing the mod…
All-time downloads
405
Public
Parameters
20.8B
96.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors25 GB · 52%
Parameter types
How the weights are stored.
U816.3B · 78%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-35B-A3B-NVFP4
This is a quantized version of Qwen/Qwen3.5-35B-A3B. This model accepts text and images as inputs and generates text as outputs. The weights and activations were quantized to FP4 using llm-compressor, reducing the model size from 67.0 GB to 21.8 GB (~3.1x reduction) while maintaining 98.8% average accuracy recovery.
Inference
As of 2/27/2026, this model is supported in vLLM nightly. To serve the model:
vllm serve Kbenkhaled/Qwen3.5-35B-A3B-NVFP4 \
--reasoning-parser qwen3 \
--enable-prefix-caching
Evaluation
Evaluated with lm-evaluation-harness, 0-shot, thinking mode ON.
| Benchmark | Qwen3.5-35B-A3B | Qwen3.5-35B-A3B-NVFP4 (this model) | Recovery |
|---|---|---|---|
| GPQA Diamond | 81.31% | 80.81% | 99.4% |
| IFEval | 95.56% | 92.93% | 97.2% |
| MMLU-Redux | 92.51% | 92.31% | 99.8% |
| Average | 89.79% | 88.68% | 98.8% |
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_5_moe
- License
- apache-2.0
- Created
- Jun 3, 2026
- Updated
- Jun 3, 2026