Downloads · 30 days
27
14% of all-time downloads
joelewing/Llama-3.2-1B-Instruct-Capybara-abliterated-GGUF
Llama-3.2-1B-Instruct-Capybara-abliterated-GGUF is a machine learning model from joelewing. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as llama3.2.
Downloads · 30 days
27
14% of all-time downloads
All-time downloads
192
Public
Repo size
1.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf1.3 GB · 100%
From the Hugging Face model README
| Parameter | Value |
|---|---|
| direction_index | 12.73 |
| attn.o_proj.max_weight | 1.49 |
| attn.o_proj.max_weight_position | 9.36 |
| attn.o_proj.min_weight | 0.65 |
| attn.o_proj.min_weight_distance | 4.53 |
| mlp.down_proj.max_weight | 1.14 |
| mlp.down_proj.max_weight_position | 12.76 |
| mlp.down_proj.min_weight | 1.02 |
| mlp.down_proj.min_weight_distance | 4.68 |
| Metric | This model | Original model (joelewing/Llama-3.2-1B-Instruct-Capybara) |
|---|---|---|
| KL divergence | 0.03 | 0 (by definition) |
| Refusals | 3/100 | 77/100 |
This model is a finetune of Llama 3.2 1B on the Capybara dataset.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.