Downloads · 30 days
21
3% of all-time downloads
AITRADER/Huihui-Qwen3.5-2B-abliterated-mxfp8-MLX
Huihui-Qwen3.5-2B-abliterated-mxfp8-MLX is a image-text-to-text model from AITRADER. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
MLX-converted version of huihui-ai/Huihui-Qwen3.5-2B-abliterated for Apple Silicon, quantized with MXFP8.
Downloads · 30 days
21
3% of all-time downloads
All-time downloads
668
Public
Parameters
2.2B
2.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.6 GB · 99%
How the weights are stored.
U321.9B · 85%
From the Hugging Face model README
MLX-converted version of huihui-ai/Huihui-Qwen3.5-2B-abliterated for Apple Silicon, quantized with MXFP8.
| Property | Value |
|---|---|
| Base model | Qwen3.5-2B |
| Type | Vision-Language Model (VLM) |
| Format | MLX MXFP8 (~9.4 bits/weight) |
| Size | ~2.6 GB |
| Abliterated | Yes — censorship layers removed |
MXFP8 provides near-native quality with ~2x compression vs fp16 — better than traditional 8-bit quantization (lower perplexity, higher benchmark scores).
pip install mlx-vlm
# Text generation
python -m mlx_vlm.generate \
--model AITRADER/Huihui-Qwen3.5-2B-abliterated-mxfp8-MLX \
--prompt "Describe this image in detail" \
--image <path-or-url>
# Chat UI
python -m mlx_vlm.chat_ui \
--model AITRADER/Huihui-Qwen3.5-2B-abliterated-mxfp8-MLX