Downloads · 30 days
13
1% of all-time downloads
Qwen3.6-27B-MLX-oQ4
deepsweet/Qwen3.6-27B-MLX-oQ4
Qwen3.6-27B-MLX-oQ4 is a text generation model from deepsweet. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This model was converted to MLX format and quantized from Qwen3.6-27B using oMLX.
All-time downloads
1.1K
Public
Parameters
26.9B
16 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors16 GB · 100%
Parameter types
How the weights are stored.
U3226.9B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
This model was converted to MLX format and quantized from Qwen3.6-27B using oMLX.
What is "oQ"?
See "oQ: oMLX Universal Dynamic Quantization" for details.
Quantizations
Unlike the Qwen3.6-35B-A3B collection, work on the full Qwen3.6-27B 4x4 table is still ongoing. So if you see a 404 link below, feel free to ask me to prioritize it.
| Text-Only | Vision-Language | Text-Only FP16 | Vision-Language FP16 |
|---|---|---|---|
| MLX-oQ8 | MLX-VL-oQ8 | MLX-oQ8-FP16 | MLX-VL-oQ8-FP16 |
| MLX-oQ6 | MLX-VL-oQ6 | MLX-oQ6-FP16 | MLX-VL-oQ6-FP16 |
| MLX-oQ5 | MLX-VL-oQ5 | MLX-oQ5-FP16 | MLX-VL-oQ5-FP16 |
| MLX-oQ4 | MLX-VL-oQ4 | MLX-oQ4-FP16 | MLX-VL-oQ4-FP16 |
See "Evaluation of various MLX quantizations" for details:
What is "VL"?
"VL" is Vision-Language, meaning quantization preserves the original model's multimodality.
No "VL" means quantization is Text-Only.
What is "FP16"?
"FP16" is an M1/M2 Apple Silicon tweak that delivers a very noticeable prompt processing boost, because older M-series lack native BF16 hardware support. See "Metal FP32 Vs BF16 Vs FP16 benchmark" for details.
No "FP16" means quantization is better suited for M3+ Apple Silicon.
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Languages
- en
- Created
- May 5, 2026
- Updated
- May 18, 2026