Downloads · 30 days
6
0% of all-time downloads
Qwen3-32B-FP8-Dynamic
khajaphysist/Qwen3-32B-FP8-Dynamic
Qwen3-32B-FP8-Dynamic is a machine learning model from khajaphysist. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
FP8-Dynamic quant to support Ampere cards
All-time downloads
7.1K
Public
Parameters
32.8B
34.3 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors34.3 GB · 100%
Parameter types
How the weights are stored.
F8_E4M331.2B · 95%
Base models
Model card
From the Hugging Face model README
FP8-Dynamic quant to support Ampere cards
Use following vllm command to run on 2x 3090
vllm serve khajaphysist/Qwen3-32B-FP8-Dynamic --enable-reasoning --reasoning-parser deepseek_r1 \
-tp 2 --gpu-memory-utilization 0.99 --disable-log-requests --enforce-eager --max-num-seqs 15
- Type
- qwen3
- License
- mit
- Created
- Apr 29, 2025
- Updated
- Apr 29, 2025