Downloads · 30 days
9
2% of all-time downloads
Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
lancew/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4 is a text generation model from lancew. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
526
Public
Parameters
30.5B
16.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors16.9 GB · 100%
Parameter types
How the weights are stored.
I3229.9B · 98%
Try a prompt
Model card
From the Hugging Face model README
Qwen3-30B-A3B-Thinking-2507 GPTQ
Requirements
- vLLM : v0.11.1
- gptqmodel : v4.0.0
Performance
| id | Dataset | Metric | Samples | bf16 | w4a16 |
|---|---|---|---|---|---|
| 1 | aime25 | AveragePass@1 | 30 | 0.7666 | 0.8334 |
| 2 | gpqa_diamond | AveragePass@1 | 198 | 0.6869 | 0.6313 |
| 3 | mmlu_pro | AverageAccuracy | 1196 | 0.7784 | 0.7617 |
| 4 | ifeval | prompt_level_strict_acc | 541 | 0.8521 | 0.8503 |
| 5 | live_code_bench | Pass@1 | 1055 | 0.7922 | 0.7687 |
- temperature 0.6
- top_p 0.95
- max_tokens 81920
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_moe
- Created
- Dec 9, 2025
- Updated
- Dec 10, 2025