Downloads · 30 days
11
18% of all-time downloads
Babsie/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated
Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated is a machine learning model from Babsie. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
<div align="center" <b style="font-size: 50px;"Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct</b
Downloads · 30 days
11
18% of all-time downloads
All-time downloads
61
Public
Parameters
8B
32.2 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors32.1 GB · 100%
From the Hugging Face model README
Interestingly, this abliterated version slightly outperforms the base model by nVidia in raw intelligence.
Looks like minimizing KL divergence (1st priority) while minimizing refusals (2nd priority) can sometimes produce a model that outperforms the base model across most benchmarks.
This was speculated for quite some time ("the rlhf alignment tax"), but it is still interesting to see, although the difference is small, so that it might be a fluke. "More testing is needed", is a bit of a cliché, but true nonetheless.
Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated is an abliterated variant of Meta's Llama 3.1 8B Instruct model with surgical removal of refusal mechanisms. This model maintains the full ONE MILLION context window while eliminating safety guardrails through orthogonalization techniques.
<0.005
~8%
Think about it as a way to measure the variance between the original model "World Model," vs the abliterated one; the lower the KL divergence, the closer the "World Model" of the two models to each other.
If the original model thinks making pineapple pizza is a crime against humanity (it is), then the abliterated model will still hold to this belief, but if asked how to make one (probably after giving you a disclaimer about what an abomination that is), it would still tell you how. In other words, most of the knowledge, quirks, and capabilities are preserved.
Intended use: General Tasks.
Censorship level: <b>Low - Very Low</b>
7.2 / 10 (10 completely uncensored)
@llm{Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated,
author = {SicariusSicariiStuff},
title = {Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated},
year = {2026},
publisher = {Hugging Face},
url = {https://huggingface.co/SicariusSicariiStuff/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct_Abliterated}
}