Downloads · 30 days
149
24% of all-time downloads
shoemoney/Muse-Glimmer-30B-Abliterated-MLX-q6
Muse-Glimmer-30B-Abliterated-MLX-q6 is a machine learning model from shoemoney. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx-vlm. The card lists the license as apache-2.0.
MLX 6-bit quantisation of Blackfrost-AI/Muse-Glimmer-30B-Abliterated-BF16.
Downloads · 30 days
149
24% of all-time downloads
All-time downloads
629
Public
Parameters
29.8B
26.4 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors26.4 GB · 100%
How the weights are stored.
U3227.9B · 94%
From the Hugging Face model README
MLX 6-bit quantisation of Blackfrost-AI/Muse-Glimmer-30B-Abliterated-BF16.
Changes: weights quantised to 6-bit from the BF16 source with
mlx_vlm.convert. No fine-tuning, no merging, no re-alignment.
Converted and measured on one machine — Apple M3 Ultra, 96 GB unified memory, macOS 27 — as part of a full ladder. Every rung in this family came from the same BF16 source with the same group size, so bit width is the only variable between them.
| Size on disk | 26.42 GB |
| Perplexity | 7.284 |
| Relative to best rung in family | 1.01× |
| Throughput (1 req / 8 concurrent) | 25.3 / 78.4 tok/s |
Perplexity measured on allenai/tulu-3-sft-mixture, 192 samples of 512 tokens,
seed 123 — identical for every rung.
Perplexity is only comparable within this family. Tokenizers differ between model families, so a number here should never be compared against a different base model's. The
×column above is the meaningful one.
pip install mlx-vlm
mlx_vlm.generate --model shoemoney/Muse-Glimmer-30B-Abliterated-MLX-q6 --prompt "Hello" --max-tokens 256
Load with mlx-vlm, not mlx-lm — this architecture is registered in mlx-vlm.
mlx_vlm.convert --hf-path Blackfrost-AI/Muse-Glimmer-30B-Abliterated-BF16 \
--mlx-path Muse-Glimmer-30B-Abliterated-q6 -q --q-bits 6 --q-group-size 64
apache-2.0, inherited from the base model. Attribution above.