Downloads · 30 days
18
4% of all-time downloads
Qwen3.5-4B-oQ4
RepublicOfKorokke/Qwen3.5-4B-oQ4
Qwen3.5-4B-oQ4 is a text generation model from RepublicOfKorokke. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This model was quantized using oQ mixed-precision quantization.
All-time downloads
432
Public
Parameters
4.5B
3.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors3.1 GB · 99%
Parameter types
How the weights are stored.
U324.2B · 93%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-4B-oQ4
This model was quantized using oQ mixed-precision quantization.
Quantization details
- Model type: qwen3_5
- Bits: 4
- Group size: 64
- Format: MLX safetensors
Benchmark
| Model | Benchmark | Accuracy | Correct | Total | Time(s) |
|---|---|---|---|---|---|
| Qwen3.5-4B-oQ3.5 | MMLU | 47.3% | 142 | 300 | 399.3 |
| Qwen3.5-4B-oQ3.5+ | MMLU | 50.0% | 150 | 300 | 402.5 |
| Qwen3.5-4B-oQ4 | MMLU | 67.3% | 202 | 300 | 515.5 |
| Qwen3.5-4B-oQ3.5 | JMMLU | 57.3% | 172 | 300 | 96.2 |
| Qwen3.5-4B-oQ3.5+ | JMMLU | 56.3% | 169 | 300 | 94.2 |
| Qwen3.5-4B-oQ4 | JMMLU | 62.7% | 188 | 300 | 121.5 |
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Mar 24, 2026
- Updated
- Mar 24, 2026