Downloads · 30 days
1.1K
24% of all-time downloads
Huihui-ThinkingCap-Qwen3.6-27B-abliterated-MLX-4bit-oMLX-MTP
pixelkaiser/Huihui-ThinkingCap-Qwen3.6-27B-abliterated-MLX-4bit-oMLX-MTP
Huihui-ThinkingCap-Qwen3.6-27B-abliterated-MLX-4bit-oMLX-MTP is a image-text-to-text model from pixelkaiser. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
This repository is packaged specifically for oMLX native MTP. The target checkpoint's main safetensors index includes all 15 languagemodel.mtp. tensors, which bind directly to oMLX's Qwen3.5/3.6 VLM MTP model tree.
All-time downloads
4.7K
Public
Parameters
27.8B
16.9 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors16.9 GB · 100%
Parameter types
How the weights are stored.
U3226.9B · 97%
Try a prompt
Base models
Model card
From the Hugging Face model README
Huihui ThinkingCap Qwen3.6 27B — oMLX 4-bit with MTP
This repository is packaged specifically for oMLX native MTP. The target checkpoint's main safetensors index includes all 15 language_model.mtp.* tensors, which bind directly to oMLX's Qwen3.5/3.6 VLM MTP model tree.
Recommended MTP runtime: use this oMLX artifact for MTP. oMLX provides the faster, more mature integrated path for this model and requires no separate drafter.
oMLX
Add this model repository to oMLX and enable Native MTP in the model settings. No separate draft-model repository is required for this oMLX artifact.
Compatibility
| Runtime | Recommended artifact |
|---|---|
| oMLX | This repository: embedded/indexed language_model.mtp.* target |
Direct mlx-vlm | Use the normal 4-bit target plus the standalone direct mlx-vlm MTP drafter |
| LM Studio MLX | Use the normal 4-bit target without MTP; runtime 1.10.1 does not support draft models for this batched VLM |
| MTPLX | Use the MTPLX sidecar target |
Do not use this embedded-MTP target as an LM Studio target: LM Studio's current MLX target loader and oMLX use different MTP packaging contracts.
Verified runtime
Verified end-to-end on Apple Silicon with oMLX 0.4.4rc1: the model loaded directly through VLMBatchedEngine, oMLX reported its native MTP patch active, and a bounded chat generation completed with the MTP path active. That smoke accepted 2 of 5 drafted tokens (40%); acceptance depends on the prompt.
Technical details
- Target trunk: MLX affine 4-bit, group size 64
- MTP tensors: 15
language_model.mtp.*entries in the mainmodel.safetensors.index.json - MTP precision: BF16
- Source revision:
44f63da8141407af529405c1e4b83fa39b70abe0 - The three previously validated target trunk shards are unchanged; the MTP payload is an additional indexed shard.
Upstream
- Model: huihui-ai/Huihui-ThinkingCap-Qwen3.6-27B-abliterated
- Base architecture: Qwen/Qwen3.6-27B
- Runtime: oMLX
- Task
- Image-Text-to-Text
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Jul 17, 2026
- Updated
- Jul 17, 2026