Downloads · 30 days
444
92% of all-time downloads
Qwen3.5-9B-MXFP8-CT-AutoRound
INCModel3/Qwen3.5-9B-MXFP8-CT-AutoRound
Qwen3.5-9B-MXFP8-CT-AutoRound is a text generation model from INCModel3. Use it when you need the model to write or continue text.
This is a MXFP8 quantization of Qwen/Qwen3.5-9B, generated by AutoRound. Please follow the license of the original model.
All-time downloads
484
Public
Parameters
9.7B
16.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors12.4 GB · 100%
Parameter types
How the weights are stored.
F8_E4M37.2B · 74%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-9B-AutoRound-MXFP8
Model Details
This is a MXFP8 quantization of Qwen/Qwen3.5-9B, generated by AutoRound. Please follow the license of the original model.
Quantization Details
- Scheme: MXFP8
- Method: AutoRound
- Base model: Qwen/Qwen3.5-9B
Evaluation
| Benchmark | Score |
|---|---|
| gsm8k | 0.9348 |
| hellaswag | 0.7781 |
| mmlu | 0.7841 |
| piqa | 0.7976 |
Produced with autoquant-agent — agent-driven quantize + evaluate + self-heal.
- Task
- Text Generation
- Type
- qwen3_5
- Created
- Aug 21, 2026
- Updated
- Aug 21, 2026