Downloads · 30 days
141
10% of all-time downloads
jorkle/Muse-Glimmer-30B-Abliterated-GGUF
Muse-Glimmer-30B-Abliterated-GGUF is a machine learning model from jorkle. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF quants (llama.cpp, museglimmer architecture supported) of the two de-abliterated variants of Muse-Glimmer-30B:
Downloads · 30 days
141
10% of all-time downloads
All-time downloads
1.4K
Public
Repo size
140 GB
Likes
2
Trending 1
Click a slice to open those files.
.gguf140 GB · 100%
From the Hugging Face model README
GGUF quants (llama.cpp, muse_glimmer architecture supported) of the two
de-abliterated variants of Muse-Glimmer-30B:
| File | Size | Variant | KL mean | KL p90 | KL p99 |
|---|---|---|---|---|---|
abliterated-normal-Q8_0.gguf | 28 GB | Normal | 0.1018 | 0.1414 | 0.1703 |
abliterated-normal-Q4_K_M.gguf | 16 GB | Normal | 0.1444 | 0.1872 | 0.2084 |
abliterated-aggressive-Q8_0.gguf | 28 GB | Aggressive | 0.1625 | 0.2384 | 0.2774 |
abliterated-aggressive-Q4_K_M.gguf | 16 GB | Aggressive | 0.2023 | 0.2746 | 0.3001 |
base-Q8_0.gguf | 28 GB | Base (reference) | — | — | — |
base-Q4_K_M.gguf | 16 GB | Base (reference) | — | — | — |
KL = response-token naive KL(p_quant ‖ p_base_Q8) over the 48-pair holdout
(quant KL includes the small base-Q8 reference distortion). Base quants are included
as the reference set used to compute quant KL.
llama-cli -m abliterated-normal-Q8_0.gguf -p "Your prompt" -cnv
# or via llama-server / llama.cpp bindings
llama-server -m abliterated-aggressive-Q4_K_M.gguf --port 8080
De-abliterated models have reduced safety refusal. Verify behavior for your use case before deployment.