Downloads · 30 days
13
1% of all-time downloads
Llama-3-70B-Instruct-norefusal
theo77186/Llama-3-70B-Instruct-norefusal
Llama-3-70B-Instruct-norefusal is a text generation model from theo77186. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
This is a model that uses the orthogonal feature ablation as featured in this paper.
All-time downloads
2.1K
Public
Parameters
70.6B
141 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors141 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3
- Model type
- llama
- Access
- Public
- Created
- May 5, 2024
- Updated
- May 5, 2024
- SHA
- f363fd8e
Try a prompt
Model card
From the Hugging Face model README
Llama 3 70B Instruct no refusal
This is a model that uses the orthogonal feature ablation as featured in this paper.
Calibration data:
- 256 prompts from jondurbin/airoboros-2.2
- 256 prompts from AdvBench
- The direction is extracted between layer 40 and 41
I haven't tested the model but like the 8B model, may still refuse some instructions. Use this model responsibly, I decline any liability resulting of the use of this model.
I will post the code later.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Featherless Ai
- live
- Created
- May 5, 2024
- Updated
- May 5, 2024