Downloads · 30 days
44
6% of all-time downloads
mlx-community/Huihui-Qwen3.6-27B-abliterated-4.5bit-msq
Huihui-Qwen3.6-27B-abliterated-4.5bit-msq is a image-text-to-text model from mlx-community. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Mixed-precision MLX quantization of huihui-ai/Huihui-Qwen3.6-27B-abliterated, quantized with MLX Smart Quantize (MSQ) — my own sensitivity-based mixed-precision quantization method for Apple Silicon. It measures per-l…
Downloads · 30 days
44
6% of all-time downloads
All-time downloads
723
Public
Parameters
27.4B
17 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors16.9 GB · 100%
How the weights are stored.
U323.7B · 79%
From the Hugging Face model README
Mixed-precision MLX quantization of huihui-ai/Huihui-Qwen3.6-27B-abliterated, quantized with MLX Smart Quantize (MSQ) — my own sensitivity-based mixed-precision quantization method for Apple Silicon. It measures per-layer NMSE and assigns optimal bit widths automatically, combining architecture knowledge with measured data.