Downloads · 30 days
34
5% of all-time downloads
Unholy-8B-DPO-OAS
Undi95/Unholy-8B-DPO-OAS
Unholy-8B-DPO-OAS is a text generation model from Undi95. Use it when you need the model to write or continue text. It is set up for transformers.
This is a TEST It was made with a custom Orthogonal Activation Steering script I shared HERE : https://huggingface.co/posts/Undi95/318385306588047663609dc1818d469455c0222 (but be ready to put your hands in some fucked…
All-time downloads
743
Public
Parameters
8B
32.1 GB on disk
Likes
7
Public
Repo makeup
Click a slice to open those files.
.safetensors32.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 4, 2024
- Updated
- May 4, 2024
- SHA
- 05d97ddf
Try a prompt
Model card
From the Hugging Face model README
This is a TEST It was made with a custom Orthogonal Activation Steering script I shared HERE : https://huggingface.co/posts/Undi95/318385306588047#663609dc1818d469455c0222 (but be ready to put your hands in some fucked up code bro)
Step :
- First I took Unholy (FT of L3 on Toxic Dataset)
- Then I trained 2 epoch of DPO on top, with the SAME dataset (https://wandb.ai/undis95/Uncensored8BDPO/runs/3rg4rz13/workspace?nw=nwuserundis95)
- Finally, I used OAS on top, bruteforcing the layer to get the best one (I don't really understand all of this, sorry)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Featherless Ai
- live
- Created
- May 4, 2024
- Updated
- May 4, 2024