Downloads · 30 days
217
15% of all-time downloads
Ling-3.0-flash-oQ4e-mtp
d1sl1ke/Ling-3.0-flash-oQ4e-mtp
Ling-3.0-flash-oQ4e-mtp is a machine learning model from d1sl1ke. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as mit.
This model was quantized using oQ (oMLX v0.5.8.dev1) mixed-precision quantization.
All-time downloads
1.4K
Public
Parameters
124B
71.6 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors71.6 GB · 100%
Parameter types
How the weights are stored.
U32124B · 100%
Base models
Model card
From the Hugging Face model README
Ling-3.0-flash-oQ4e-mtp
This model was quantized using oQ (oMLX v0.5.8.dev1) mixed-precision quantization.
MTP included but currently is not supported by oMLX.
Original model: Ling-3.0-flash-fp8
This model for M3, M4, M5.
For Mac M1, M2 try this.
Benchmarks
Mac Studio M4 Max 40c, 128 GB
| Parameter | Value |
|---|---|
| Model | Ling-3.0-flash-oQ4e-mtp (70.0 GB VRAM) |
| Benchmark Context | Code (Mixed) |
| Generation Length | 128 tokens (fixed) |
Metrics (Single Request)
| Test | TTFT (ms) | TPOT (ms/tok) | pp TPS | tg TPS | E2E Latency | Throughput | Peak Mem |
|---|---|---|---|---|---|---|---|
| pp8192/tg128 | 8,874.6 | 18.14 | 923.1 tok/s | 55.6 tok/s | 11.182 s | 744.1 tok/s | 70.18 GB |
| pp32768/tg128 | 40,822.9 | 19.77 | 802.7 tok/s | 51.0 tok/s | 43.340 s | 759.0 tok/s | 74.59 GB |
| pp65536/tg128 | 99,803.4 | 22.06 | 656.7 tok/s | 45.7 tok/s | 102.614 s | 639.9 tok/s | 80.54 GB |
Quantization details
- Model type: bailing_hybrid
- Bits: 4
- Group size: 64
- Format: MLX safetensors
- Library
- mlx
- Type
- bailing_hybrid
- License
- mit
- Created
- Aug 8, 2026
- Updated
- Aug 11, 2026