Downloads · 30 days
146
10% of all-time downloads
ChiKoi7/SmolLM2-1.7B-Instruct-Heretic
SmolLM2-1.7B-Instruct-Heretic is a text generation model from ChiKoi7. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A decensored version of HuggingFaceTB/SmolLM2-1.7B-Instruct, made using Heretic v1.1.0
Downloads · 30 days
146
10% of all-time downloads
All-time downloads
1.5K
Public
Parameters
1.7B
15.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 GB · 100%
From the Hugging Face model README
A decensored version of HuggingFaceTB/SmolLM2-1.7B-Instruct, made using Heretic v1.1.0
Quantized/GGUF versions available here: ChiKoi7/SmolLM2-1.7B-Instruct-Heretic-GGUF
| SmolLM2-1.7B-Instruct-Heretic <br> | Original model <br> SmolLM2-1.7B-Instruct | |
|---|---|---|
| Refusals | 5/100 | 37/100 |
| KL divergence | 0.0523 | 0 (by definition) |
| Parameter | Value |
|---|---|
| direction_index | 18.34 |
| attn.o_proj.max_weight | 0.81 |
| attn.o_proj.max_weight_position | 14.52 |
| attn.o_proj.min_weight | 0.56 |
| attn.o_proj.min_weight_distance | 8.50 |
| mlp.down_proj.max_weight | 1.14 |
| mlp.down_proj.max_weight_position | 17.18 |
| mlp.down_proj.min_weight | 0.93 |
| mlp.down_proj.min_weight_distance | 7.16 |