Downloads · 30 days
40
6% of all-time downloads
AITRADER/Huihui-Step3-VL-10B-abliterated-mlx-8bit
Huihui-Step3-VL-10B-abliterated-mlx-8bit is a image-text-to-text model from AITRADER. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
MLX conversion (8-bit affine quantization, group size 64) of huihui-ai/Huihui-Step3-VL-10B-abliterated.
Downloads · 30 days
40
6% of all-time downloads
All-time downloads
632
Public
Parameters
9.8B
11.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors11.3 GB · 100%
How the weights are stored.
U329.6B · 95%
From the Hugging Face model README
MLX conversion (8-bit affine quantization, group size 64) of huihui-ai/Huihui-Step3-VL-10B-abliterated.
model-*.safetensors + model.safetensors.index.jsonstep3_vl_mlx.py (referenced by config.json via model_file)This repo includes a minimal MLX module tree primarily meant for loading and quantization. Multimodal/image inference is not implemented in the included model file.
pip install -U mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("AITRADER/Huihui-Step3-VL-10B-abliterated-mlx-8bit")
print(generate(model, tokenizer, prompt="Hello!", max_tokens=128))
Original model: huihui-ai/Huihui-Step3-VL-10B-abliterated