Downloads · 30 days
109
4% of all-time downloads
Qwen3.6-35B-A3B-MLX-VL-oQ8
deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ8
Qwen3.6-35B-A3B-MLX-VL-oQ8 is a text generation model from deepsweet. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This model was converted to MLX format and quantized from Qwen3.6-35B-A3B using oMLX.
All-time downloads
3K
Public
Parameters
35.1B
42.9 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors37.7 GB · 100%
Parameter types
How the weights are stored.
U3234.6B · 99%
Try a prompt
Base models
Model card
From the Hugging Face model README
This model was converted to MLX format and quantized from Qwen3.6-35B-A3B using oMLX.
What is "oQ"?
See "oQ: oMLX Universal Dynamic Quantization" for details.
Quantizations
| Text-Only | Vision-Language | Text-Only FP16 | Vision-Language FP16 |
|---|---|---|---|
| MLX-oQ8 | MLX-VL-oQ8 | MLX-oQ8-FP16 | MLX-VL-oQ8-FP16 |
| MLX-oQ6 | MLX-VL-oQ6 | MLX-oQ6-FP16 | MLX-VL-oQ6-FP16 |
| MLX-oQ5 | MLX-VL-oQ5 | MLX-oQ5-FP16 | MLX-VL-oQ5-FP16 |
| MLX-oQ4 | MLX-VL-oQ4 | MLX-oQ4-FP16 | MLX-VL-oQ4-FP16 |
See "Evaluation of various MLX quantizations" for details:
What is "VL"?
"VL" is Vision-Language, meaning quantization preserves the original model's multimodality.
No "VL" means quantization is Text-Only.
What is "FP16"?
"FP16" is an M1/M2 Apple Silicon tweak that delivers a very noticeable prompt processing boost, because older M-series lack native BF16 hardware support. See "Metal FP32 Vs BF16 Vs FP16 benchmark" for details.
No "FP16" means quantization is better suited for M3+ Apple Silicon.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5_moe
- License
- apache-2.0
- Languages
- en
- Created
- Apr 24, 2026
- Updated
- May 10, 2026