Downloads · 30 days
46
2% of all-time downloads
Llama-3-8B-Instruct-norefusal
theo77186/Llama-3-8B-Instruct-norefusal
Llama-3-8B-Instruct-norefusal is a text generation model from theo77186. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
This is a model that uses the orthogonal feature ablation as featured in this paper.
All-time downloads
2.3K
Public
Parameters
8B
16.1 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors16.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- May 4, 2024
- Updated
- May 5, 2024
- SHA
- c4e1d87f
Try a prompt
Model card
From the Hugging Face model README
Llama 3 8B Instruct no refusal
This is a model that uses the orthogonal feature ablation as featured in this paper.
Calibration data:
- 256 prompts from jondurbin/airoboros-2.2
- 256 prompts from AdvBench
- The direction is extracted between layer 16 and 17
The model is still refusing some instructions related to violence, I suspect that a full fine-tune might be needed to remove the rest of the refusals. Use this model responsibly, I decline any liability resulting of the use of this model.
I will post the code later.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Featherless Ai
- live
- Created
- May 4, 2024
- Updated
- May 5, 2024