Downloads · 30 days
12
3% of all-time downloads
Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
lancew/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4 is a text generation model from lancew. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
422
Public
Parameters
30.5B
16.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.9 GB · 100%
Parameter types
How the weights are stored.
I3229.9B · 98%
Try a prompt
Model card
From the Hugging Face model README
Qwen3-30B-A3B-Instruct-2507 GPTQ
Requirements
- vLLM : v0.11.1
- gptqmodel : v4.0.0
Performance
| id | Dataset | Metric | Samples | nv-score-bf16 | nv-score-fp8 | nv-score-w4a16 |
|---|---|---|---|---|---|---|
| 1 | aime25 | AveragePass@1 | 30 | 0.5666 | 0.594417 | 0.5 |
| 2 | gpqa_diamond | AveragePass@1 | 198 | 0.667 | 0.64848 | 0.6263 |
| 3 | mmlu_pro | AverageAccuracy | 1196 | 0.7751 | 0.7755 | 0.7466 |
| 4 | ifeval | prompt_level_strict_acc | 541 | 0.8355 | 0.83952 | 0.8429 |
| 5 | live_code_bench | Pass@1 | 1055 | 0.563 | 0.56358 | 0.491 |
- temperature 0.7
- top_p 0.8
- max_tokens 16384
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_moe
- Created
- Dec 10, 2025
- Updated
- Dec 11, 2025