Downloads · 30 days
77
13% of all-time downloads
Gavvvin/Muse-Glimmer-30B-Abliterated-OID-IQ3_XXS_XL-quant
Muse-Glimmer-30B-Abliterated-OID-IQ3_XXS_XL-quant is a image-text-to-text model from Gavvvin. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Custom GGUF quantization of Blackfrost-AI/Muse-Glimmer-30B-Abliterated-BF16.
Downloads · 30 days
77
13% of all-time downloads
All-time downloads
595
Public
Repo size
12.8 GB
Likes
2
Public
Click a slice to open those files.
.gguf12.8 GB · 100%
From the Hugging Face model README
Custom GGUF quantization of
Blackfrost-AI/Muse-Glimmer-30B-Abliterated-BF16.
This quant was produced with an experimental quantization workflow intended to improve the quality/size tradeoff relative to a conventional quant of the same source model.
Blackfrost-AI/Muse-Glimmer-30B-Abliterated-BF16The following results are from local factual-summary testing and are not a standardized leaderboard evaluation.
| Variant | Approx. size | Local factual score |
|---|---|---|
| Q8 reference | — | ~72% |
| Standard IQ4_XS | ~14.2 GB | ~67% |
| This custom quant | ~11.9 GB | ~72% |
In this local test, the custom quant matched the approximate Q8 factual score while being about 2.3 GB smaller than the tested standard IQ4_XS representation.
Results may vary with prompt, sampling settings, runtime, hardware, and benchmark methodology.
With a recent llama.cpp build:
llama-cli -m ./YOUR_MODEL_FILE.gguf --jinja -ngl 999
Or with the llama.cpp server:
llama-server -m ./YOUR_MODEL_FILE.gguf --jinja -ngl 999
Replace YOUR_MODEL_FILE.gguf with the actual filename in this repository.
Muse Glimmer is an image-text-to-text model.
If your llama.cpp build requires a separate multimodal projector, use a compatible
mmproj*.gguf for this model lineage:
llama-server \
-m ./YOUR_MODEL_FILE.gguf \
--mmproj ./YOUR_MMPROJ_FILE.gguf \
--jinja \
-ngl 999
If this repository does not include an mmproj file, users will need to obtain or generate
a compatible projector separately for image input.
When comparing this quant against other variants, please report:
Source model:
Blackfrost-AI/Muse-Glimmer-30B-Abliterated-BF16
Please also review the upstream model card for its original Muse Glimmer lineage, intended use, limitations, and safety information.
Apache-2.0, following the source repository.