Downloads · 30 days
21
1% of all-time downloads
Qwen3-30B-A3B-FP8-Dynamic
khajaphysist/Qwen3-30B-A3B-FP8-Dynamic
Qwen3-30B-A3B-FP8-Dynamic is a text generation model from khajaphysist. Use it when you need the model to write or continue text. It is set up for transformers.
FP8-Dynamic quant to support Ampere cards.
All-time downloads
3.2K
Public
Parameters
30.6B
31.2 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors31.2 GB · 100%
Parameter types
How the weights are stored.
F8_E4M329.9B · 98%
Try a prompt
Base models
Model card
From the Hugging Face model README
FP8-Dynamic quant to support Ampere cards.
Use following vllm command to run on 2x 3090
vllm serve khajaphysist/Qwen3-30B-A3B-FP8-Dynamic --enable-reasoning --reasoning-parser deepseek_r1 \
-tp 2 --gpu-memory-utilization 0.99 --disable-log-requests --enforce-eager --max-num-seqs 15
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_moe
- Created
- Apr 29, 2025
- Updated
- Apr 29, 2025