Downloads · 30 days
19
13% of all-time downloads
llama3.1-gutenberg-8B-Heretic
ChiKoi7/llama3.1-gutenberg-8B-Heretic
llama3.1-gutenberg-8B-Heretic is a text generation model from ChiKoi7. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
A decensored version of nbeerbower/llama3.1-gutenberg-8B, made using Heretic v1.1.0
All-time downloads
150
Public
Parameters
8B
16.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- Dec 23, 2025
- Updated
- Dec 23, 2025
- SHA
- 0dd3fd46
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
llama3.1-gutenberg-8B-Heretic
A decensored version of nbeerbower/llama3.1-gutenberg-8B, made using Heretic v1.1.0
| llama3.1-gutenberg-8B-Heretic | Original model (llama3.1-gutenberg-8B) | |
|---|---|---|
| Refusals | 3/100 | 97/100 |
| KL divergence | 0.0615 | 0 (by definition) |
Heretic Abliteration Parameters
| Parameter | Value |
|---|---|
| direction_index | 13.98 |
| attn.o_proj.max_weight | 1.34 |
| attn.o_proj.max_weight_position | 19.54 |
| attn.o_proj.min_weight | 1.33 |
| attn.o_proj.min_weight_distance | 12.82 |
| mlp.down_proj.max_weight | 1.22 |
| mlp.down_proj.max_weight_position | 24.24 |
| mlp.down_proj.min_weight | 1.06 |
| mlp.down_proj.min_weight_distance | 11.39 |
llama3.1-gutenberg-8B
VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct finetuned on jondurbin/gutenberg-dpo-v0.1.
Method
Finetuned using 2x RTX 4060 for 3 epochs.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Created
- Dec 23, 2025
- Updated
- Dec 23, 2025