Downloads · 30 days
180
3% of all-time downloads
Qwen3-Coder-30B-A3B-MXFP4-MOE-GGUF
FreedomAISVR/Qwen3-Coder-30B-A3B-MXFP4-MOE-GGUF
Qwen3-Coder-30B-A3B-MXFP4-MOE-GGUF is a text generation model from FreedomAISVR. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
This repository contains MXFP4MOE quantized GGUF of Qwen3-Coder-30B-A3B-Instruct.
All-time downloads
5.7K
Public
Repo size
17.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf17.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- May 16, 2026
- Updated
- May 16, 2026
- SHA
- 44ae81f9
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-Coder-30B-A3B-Instruct-GGUF
MXFP4_MOE Quantization
This repository contains MXFP4_MOE quantized GGUF of Qwen3-Coder-30B-A3B-Instruct.
Model Details
| Property | Value |
|---|---|
| Base Model | Qwen3-Coder-30B-A3B-Instruct |
| Architecture | Qwen3MoE |
| Parameters | 30B (3.6B active, 128 experts, 8 activated) |
| Quantization | MXFP4_MOE (OCP MXFP4 E2M1, block 32, shared 8-bit block exponents) |
| BPW | 4.47 |
| File Size | ~17.1 GB |
| Context Length | 32K |
Download
huggingface-cli download FreedomAISVR/Qwen3-Coder-30B-A3B-MXFP4-MOE-GGUF qwen3-coder-30b-a3b-mxfp4_moe.gguf --local-dir . --local-dir-use-symlinks False
Quantization Information
This model uses MXFP4 (Microscaling FP4) quantization via llama.cpp's MXFP4_MOE type:
- E2M1 format: 1 sign bit, 2 exponent bits, 1 mantissa bit
- Block size: 32 elements sharing an 8-bit block exponent
- Expert weights: Quantized to MXFP4 (3 ffn_exps tensors per layer)
- Attention weights: Quantized to Q8_0 (8-bit block quantization)
- Other weights: Kept in F32/F16
Verification
After download, verify the file:
echo "9f5a07e402df2aa16b9b4fcee22b5132 *qwen3-coder-30b-a3b-mxfp4_moe.gguf" | md5sum -c
Credits
- Task
- Text Generation
- Library
- gguf
- License
- other
- Languages
- en, multilingual
- Created
- May 16, 2026
- Updated
- May 16, 2026