Downloads · 30 days
20
4% of all-time downloads
AITRADER/Huihui-Qwen3.5-0.8B-abliterated-mxfp8-MLX
Huihui-Qwen3.5-0.8B-abliterated-mxfp8-MLX is a image-text-to-text model from AITRADER. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
MLX-converted version of huihui-ai/Huihui-Qwen3.5-0.8B-abliterated for Apple Silicon, quantized with MXFP8.
Downloads · 30 days
20
4% of all-time downloads
All-time downloads
556
Public
Parameters
853M
998 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors978 MB · 97%
How the weights are stored.
U32752M · 88%
From the Hugging Face model README
MLX-converted version of huihui-ai/Huihui-Qwen3.5-0.8B-abliterated for Apple Silicon, quantized with MXFP8.
| Property | Value |
|---|---|
| Base model | Qwen3.5-0.8B |
| Type | Vision-Language Model (VLM) |
| Format | MLX MXFP8 (~9.2 bits/weight) |
| Size | ~0.98 GB |
| Abliterated | Yes — censorship layers removed |
MXFP8 provides near-native quality with ~2x compression vs fp16 — better than traditional 8-bit quantization (lower perplexity, higher benchmark scores).
pip install mlx-vlm
# Text generation
python -m mlx_vlm.generate \
--model AITRADER/Huihui-Qwen3.5-0.8B-abliterated-mxfp8-MLX \
--prompt "Describe this image in detail" \
--image <path-or-url>
# Chat UI
python -m mlx_vlm.chat_ui \
--model AITRADER/Huihui-Qwen3.5-0.8B-abliterated-mxfp8-MLX