Downloads · 30 days
49
0% of all-time downloads
Qwen3.5-27B-NVFP4
Sehyo/Qwen3.5-27B-NVFP4
Qwen3.5-27B-NVFP4 is a machine learning model from Sehyo. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a quantized version of Qwen/Qwen3.5-27B using the NVFP4 quantization scheme. Supports MTP and multi-modal.
All-time downloads
12.1K
Public
Parameters
19.1B
28.6 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors28.6 GB · 100%
Parameter types
How the weights are stored.
U89.4B · 49%
Base models
Model card
From the Hugging Face model README
Qwen3.5-27B-NVFP4
This is a quantized version of Qwen/Qwen3.5-27B using the NVFP4 quantization scheme. Supports MTP and multi-modal.
Please use nightly vLLM for support.
Changelog
- 02/03/2026: Initial upload.
Calibration
- Samples: 128 (64 from each dataset) - This model is not a MoE model so high sample count not necessary.
- Datasets:
- HuggingFaceH4/ultrachat_200k (
train_sftsplit) - nvidia/Nemotron-Post-Training-Dataset-v2 (
chatsplit)
- HuggingFaceH4/ultrachat_200k (
- Max sequence length: 4096
Creation
This model was created using VLLM's LLM Compressor. The quantization ignores lm_head, re:.*linear_attn.*, and re:model\.visual\..* layers, preserving the vision encoder and linear attention modules at full precision. The model was loaded with AutoModelForImageTextToText.
- Type
- qwen3_5
- Created
- Mar 1, 2026
- Updated
- Mar 1, 2026