Downloads · 30 days
44
8% of all-time downloads
AITRADER/Huihui-Step3-VL-10B-abliterated-mlx-fp16
Huihui-Step3-VL-10B-abliterated-mlx-fp16 is a image-text-to-text model from AITRADER. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
MLX conversion (fp16) of huihui-ai/Huihui-Step3-VL-10B-abliterated.
Downloads · 30 days
44
8% of all-time downloads
All-time downloads
533
Public
Parameters
9.8B
20.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors20.3 GB · 100%
From the Hugging Face model README
MLX conversion (fp16) of huihui-ai/Huihui-Step3-VL-10B-abliterated.
model-*.safetensors + model.safetensors.index.jsonstep3_vl_mlx.py (referenced by config.json via model_file)This repo includes a minimal MLX module tree primarily meant for loading and quantization. Multimodal/image inference is not implemented in the included model file.
pip install -U mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("AITRADER/Huihui-Step3-VL-10B-abliterated-mlx-fp16")
print(generate(model, tokenizer, prompt="Hello!", max_tokens=128))
Original model: huihui-ai/Huihui-Step3-VL-10B-abliterated