Downloads · 30 days
150
10% of all-time downloads
mlasli/Nemotron-3.5-Lightning-30B-A3B-Heretic-Uncensored-Q6_K-GGUF
Nemotron-3.5-Lightning-30B-A3B-Heretic-Uncensored-Q6_K-GGUF is a text generation model from mlasli. Use it when you need the model to write or continue text. The card lists the license as other.
GGUF quantization of mlasli/Nemotron-3.5-Lightning-30B-A3B-Heretic-Uncensored-BF16 — NVIDIA-Nemotron-3.5-Lightning-30B-A3B (31.6B total / 3B active) with its refusal direction removed via Heretic.
Downloads · 30 days
150
10% of all-time downloads
All-time downloads
1.5K
Public
Repo size
33.5 GB
Likes
1
Public
Click a slice to open those files.
.gguf33.5 GB · 100%
From the Hugging Face model README
GGUF quantization of mlasli/Nemotron-3.5-Lightning-30B-A3B-Heretic-Uncensored-BF16 — NVIDIA-Nemotron-3.5-Lightning-30B-A3B (31.6B total / 3B active) with its refusal direction removed via Heretic.
What this is for: the same abliterated hybrid Mamba-MoE model, quantized to 33.5 GB so it runs locally via llama.cpp.
nemotron_h_moe (requires llama.cpp build b10326+)llama-cli).| Refusals | Compliance | KL Divergence | Trials |
|---|---|---|---|
| 0% | 100% | 0.0397 | 200 |
Independent eval of the merged BF16 model (50 harmful-behavior prompts). The automated Zou keyword detector false-positives on words like "illegal"/"unethical" appearing inside compliant answers; manual review found 0 genuine refusals.
llama-cli -m Nemotron-3.5-Lightning-30B-A3B-Heretic-Uncensored-Q6_K-GGUF.gguf \
-cnv -st -p "What is 2+2?"
Create a Modelfile:
FROM ./Nemotron-3.5-Lightning-30B-A3B-Heretic-Uncensored-Q6_K-GGUF.gguf
Then:
ollama create nemotron-3.5-30b-heretic-q6_k
ollama run nemotron-3.5-30b-heretic-q6_k
Abliteration removes safety alignment. Use responsibly and in accordance with your local laws and the upstream NVIDIA Open Model License.