Downloads · 30 days
232
1% of all-time downloads
inferencerlabs/Qwen3.6-35B-A3B-MLX-Q9
Qwen3.6-35B-A3B-MLX-Q9 is a image-text-to-text model from inferencerlabs. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx.
See Qwen3.6-35B-A3B in action: demonstration videos
Downloads · 30 days
232
1% of all-time downloads
All-time downloads
19K
Public
Parameters
69.8B
39.9 GB on disk
Likes
5
Public
Click a slice to open those files.
.safetensors39.9 GB · 100%
How the weights are stored.
U3269.3B · 99%
From the Hugging Face model README
See Qwen3.6-35B-A3B in action: demonstration videos
For improved performance, download and enable a compatible MTP speculative decoder.
Q9bit quant typically achieves near lossless accuracy in our coding test
| Quantization | Perplexity | Token Accuracy | Missed Divergence |
|---|---|---|---|
| Q3.5 | 168.0 | 43.45% | 72.57% |
| Q4.5 | 1.33593 | 91.65% | 27.61% |
| Q5.5 | 1.23437 | 95.05% | 17.28% |
| Q6.5 | 1.21875 | 96.95% | 12.03% |
| Q8.5 | 1.21875 | 97.65% | 9.92% |
| Q9 | 1.21093 | 97.80% | 9.60% |
| Base | 1.20312 | 100.0% | 0.000% |
We are not the creator, originator, or owner of any model listed. Each model is created and provided by third parties. Models may not always be accurate or contextually appropriate. You are responsible for verifying the information before making important decisions. We are not liable for any damages, losses, or issues arising from its use, including data loss or inaccuracies in AI-generated content.