Downloads · 30 days
39
15% of all-time downloads
Qwen3-1.7B-W2.79-QAOPD
MingZwhy/Qwen3-1.7B-W2.79-QAOPD
Qwen3-1.7B-W2.79-QAOPD is a text generation model from MingZwhy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Qwen3-1.7B quantized to 2.79 bits per weight, then recovered with quantization-aware distillation followed by on-policy distillation. Quantization is baked in: load it and evaluate it.
All-time downloads
252
Public
Parameters
1.7B
3.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Sep 20, 2026
- Updated
- Sep 20, 2026
- SHA
- c6aec282
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3-1.7B — W2.79, QAD + OPD
Qwen3-1.7B quantized to 2.79 bits per weight, then recovered with quantization-aware distillation followed by on-policy distillation. Quantization is baked in: load it and evaluate it.
Code, evaluation harness and the training recipe: MingZwhy/QAOPD.
Results
Measured through this checkpoint, against the unquantized model.
| GSM8K | MATH-500 | AMC23 | MBPP | HumanEval | QA9 | |
|---|---|---|---|---|---|---|
| this model | 54.28 | 49.60 | 19.38 | 52.0 | 59.1 | 51.81 |
| Qwen3-1.7B BF16 | 68.76 | 54.40 | 31.72 | 54.0 | 67.1 | 54.54 |
GSM8K 5-shot strict-match, MATH-500 4-shot, AMC23 avg@16, MBPP and HumanEval pass@1 greedy, QA9 the equal-weight mean of nine likelihood-scored benchmarks.
Quantization
| weights | mixed INT1.58 / INT4 in blocks of 256, 50% of blocks at INT4 → 2.79 bits effective |
| embedding, output head | INT4 |
| activations | INT8 |
| KV cache | 16-bit |
Use
from transformers import AutoModelForCausalLM, AutoTokenizer
name = "MingZwhy/Qwen3-1.7B-W2.79-QAOPD"
model = AutoModelForCausalLM.from_pretrained(name, trust_remote_code=True)
tok = AutoTokenizer.from_pretrained(name)
To reproduce the numbers above with the same harness, see docs/EVALUATION.md.
License
Apache-2.0, inherited from Qwen3-1.7B.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Created
- Sep 20, 2026
- Updated
- Sep 20, 2026