Downloads · 30 days
21
2% of all-time downloads
inferencerlabs/Qwen3.5-0.8B-LM-MLX-Q9
Qwen3.5-0.8B-LM-MLX-Q9 is a text generation model from inferencerlabs. Use it when you need the model to write or continue text. It is set up for mlx.
See Qwen3.5-0.8B MLX in action - demonstration video - coming soon
Downloads · 30 days
21
2% of all-time downloads
All-time downloads
880
Public
Parameters
752M
867 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors847 MB · 98%
How the weights are stored.
U32752M · 100%
From the Hugging Face model README
See Qwen3.5-0.8B MLX in action - demonstration video - coming soon
q9Bit quant typically achieves near lossless accuracy in our coding test
| Quantization | Perplexity | Token Accuracy | Missed Divergence |
|---|---|---|---|
| q3.5 | 168.0 | 43.45% | 72.57% |
| q4.5 | 1.33593 | 91.65% | 27.61% |
| q4.8 | 1.28125 | 93.75% | 21.15% |
| q5.5 | 1.23437 | 95.05% | 17.28% |
| q6.5 | 1.21875 | 96.95% | 12.03% |
| q8.5 | 1.21093 | 97.55% | 10.50% |
| q9 | 1.21093 | 97.55% | 10.50% |
| Base | 1.20312 | 100.0% | 0.000% |
We are not the creator, originator, or owner of any model listed. Each model is created and provided by third parties. Models may not always be accurate or contextually appropriate. You are responsible for verifying the information before making important decisions. We are not liable for any damages, losses, or issues arising from its use, including data loss or inaccuracies in AI-generated content.