Downloads · 30 days
33
20% of all-time downloads
Qwen3-Coder-30B-A3B-Instruct-exl3
amanwalksdownthestreet/Qwen3-Coder-30B-A3B-Instruct-exl3
Qwen3-Coder-30B-A3B-Instruct-exl3 is a text generation model from amanwalksdownthestreet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
ExLlamaV3 quantizations of Qwen3-Coder-30B-A3B-Instruct with tensor-level (L3) optimization and boosted attention layers (5-6 bit). Maximum effort applied towards the goal of achieving the best possible quantizations…
All-time downloads
162
Public
Repo size
140 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.3 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3_moe
- Access
- Public
- Created
- Dec 31, 2025
- Updated
- Jul 18, 2026
- SHA
- 9dbda94f
Try a prompt
Base models
Model card
From the Hugging Face model README
ExLlamaV3 quantizations of Qwen3-Coder-30B-A3B-Instruct with tensor-level (L3) optimization and boosted attention layers (5-6 bit). Maximum effort applied towards the goal of achieving the best possible quantizations at the expense of time and compute.
Using this measurement.json file and the base quants provided, additional highly-optimized quantizations can be made in seconds at any reasonable bpw by anyone. All work done with ExLlamaV3 v0.0.18.
Optimized
VRAM-targeted quants using exl3's measure.py → optimize.py → recompile.py pipeline.
| Size | bpw | Target | |
|---|---|---|---|
| 3.34bpw-h5-opt | 13 GB | 3.34 | 16GB @ 128k |
| 4.90bpw-h6-opt | 18 GB | 4.90 | 24GB @ 262k |
The 4.90bpw quant hit the optimization ceiling - requesting higher bpw (5.30, 6.95) produced identical 4.83bpw pre-boost output, indicating no further beneficial tensor swaps available.
Base
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_moe
- License
- apache-2.0
- Languages
- en, zh
- Created
- Dec 31, 2025
- Updated
- Jul 18, 2026