Downloads · 30 days
12
29% of all-time downloads
qwen2.5-7b-fp8-mixed
NouraAlqasim/qwen2.5-7b-fp8-mixed
qwen2.5-7b-fp8-mixed is a machine learning model from NouraAlqasim. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Post-training W8A8 quantization with NVIDIA ModelOpt (FP8DEFAULTCFG).
All-time downloads
42
Public
Parameters
7.6B
17.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8.7 GB · 100%
Parameter types
How the weights are stored.
F8_E4M36.5B · 86%
Base models
Model card
From the Hugging Face model README
qwen2.5-7b · FP8 · calibrated on 64 MSA + 64 Gulf
Post-training W8A8 quantization with NVIDIA ModelOpt (FP8_DEFAULT_CFG).
| base model | Qwen/Qwen2.5-7B-Instruct |
| base dtype | float16 |
| precision | FP8 (W8A8) |
| calibration variety | 64 MSA + 64 Gulf |
| calibration file | calib3_mixed.txt |
| calibration samples | 128 dialogues, truncated at 128 tokens |
| calibration source | Almheiri/ArabCulture-Dialogue rev 9acd60cbbb4f, seed 1448 |
| weight MSE | 2.050e-07 |
| activation quantizers calibrated | 196/196 |
| environment | torch 2.8.0+cu128 · transformers 4.57.6 · modelopt 0.45.0 |
FP8 weight scales are data-free. What the calibration variety changes is the static
per-tensor activation scales, exported as input_scale. Sibling checkpoints
-fp8-msa, -fp8-gulf and -fp8-mixed differ in exactly that and nothing else.
Not loadable by plain transformers — config.json declares quantization type modelopt.
vllm serve NouraAlqasim/qwen2.5-7b-fp8-mixed --quantization modelopt
- Type
- qwen2
- Created
- Aug 15, 2026
- Updated
- Aug 15, 2026