Downloads · 30 days
1.9K
0% of all-time downloads
Qwen3.5-122B-A10B-NVFP4
Sehyo/Qwen3.5-122B-A10B-NVFP4
Qwen3.5-122B-A10B-NVFP4 is a image-text-to-text model from Sehyo. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is a quantized version of Qwen/Qwen3.5-122B-A10B using the NVFP4 quantization scheme.
All-time downloads
847K
Public
Parameters
71.2B
81.5 GB on disk
Likes
69
Public
Repo makeup
Click a slice to open those files.
.safetensors81.5 GB · 100%
Parameter types
How the weights are stored.
U858.7B · 80%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-122B-A10B-NVFP4
This is a quantized version of Qwen/Qwen3.5-122B-A10B using the NVFP4 quantization scheme.
Please use nightly vLLM for support.
Changelog
- 02/03/2026: Added MTP (multi-token prediction) weights from source checkpoint, enabling speculative decoding with vLLM.
- 25/02/2026: Initial upload.
Calibration
- Samples: 512 (256 from each dataset)
- Datasets:
- HuggingFaceH4/ultrachat_200k (
train_sftsplit) - nvidia/Nemotron-Post-Training-Dataset-v2 (
chatsplit)
- HuggingFaceH4/ultrachat_200k (
- Max sequence length: 4096
- All experts calibrated:
moe_calibrate_all_experts=True
Creation
This model was created using VLLM's LLM Compressor with Qwen3.5 MoE support added via PR #2383. The PR adds a custom CalibrationQwen3MoeSparseMoeBlock that routes calibration data to all experts during quantization, ensuring every expert receives proper calibration for accurate NVFP4 quantization.
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_5_moe
- Created
- Feb 25, 2026
- Updated
- Mar 2, 2026