Downloads · 30 days
10
15% of all-time downloads
Jan-nano-128k-heretic
nitrox/Jan-nano-128k-heretic
Jan-nano-128k-heretic is a machine learning model from nitrox. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Abliterated version of menlo-labs/Jan-nano-128k.
All-time downloads
66
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Feb 22, 2026
- Updated
- Feb 23, 2026
- SHA
- ab91603c
Base models
Model card
From the Hugging Face model README
Jan-nano-128k — Abliterated
Abliterated version of menlo-labs/Jan-nano-128k.
Base: Llama 3.1 8B fine-tune with 128K context window.
Abliteration
Performed with heretic — Optuna multi-objective optimization (minimize refusals + KL divergence from base).
- Trials: 500 (50 × 10 parallel GPUs)
- Result: 0 refusals on eval set, KL divergence minimal
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"nitrox/Jan-nano-128k-heretic",
device_map="auto",
torch_dtype="bfloat16",
)
tokenizer = AutoTokenizer.from_pretrained("nitrox/Jan-nano-128k-heretic")
Disclaimer
Refusal mechanisms have been removed. Use responsibly and in accordance with applicable laws.
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Feb 22, 2026
- Updated
- Feb 23, 2026