Downloads · 30 days
17
25% of all-time downloads
majentik/UI-Mate-27B-MLX-3bit
UI-Mate-27B-MLX-3bit is a image-text-to-text model from majentik. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
MLX 3bit (affine, group size 32) quantized variant of tencent/UI-Mate-27B (text tower quantized; vision tower and projector retained in BF16) for Apple silicon via mlx-lm.
Downloads · 30 days
17
25% of all-time downloads
All-time downloads
69
Public
Parameters
27.4B
14.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors14.4 GB · 100%
How the weights are stored.
U3226.9B · 98%
From the Hugging Face model README
MLX 3bit (affine, group size 32) quantized variant of tencent/UI-Mate-27B (text tower quantized; vision tower and projector retained in BF16) for Apple silicon via mlx-lm.
53543405c72b93775f831d7c7fce7c4d64972636 (Apache-2.0 (upstream LICENSE)).mlx_lm.convert (mlx-lm 0.31.3): affine,
3-bit, group size 32.Before upload this pack passed a deterministic coherence gate: greedy
48-token chat generation loaded through
mlx_lm.load, judged for emptiness, repetition loops, multi-script
gibberish, and special-token debris. Verdict: ok.
pip install mlx-lm
mlx_lm.generate --model majentik/UI-Mate-27B-MLX-3bit --prompt "Hello"
| Benchmark | Score |
|---|---|
| arc_easy_acc | 0.6650 |
| hellaswag_acc | 0.5150 |