Downloads · 30 days
0
Todd_Proxy_LoRA_7b
autobots/Todd_Proxy_LoRA_7b
Todd_Proxy_LoRA_7b is a machine learning model from autobots. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Trained on 100k dumped messages from the 'chan' todd proxy. I could not dedupe the dataset but it has had serious effect on the llama7b I used. Calls me master a whole bunch more now.
Access
Public
Updated May 21, 2023
Repo size
604 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin604 MB · 100%
At a glance
- Access
- Public
- Created
- May 17, 2023
- Updated
- May 21, 2023
- SHA
- dc5d2454
Model card
From the Hugging Face model README
Trained on 100k dumped messages from the 'chan' todd proxy. I could not dedupe the dataset but it has had serious effect on the llama7b I used. Calls me master a whole bunch more now.
Content isn't SFW so be aware. Trained in 4-bit for 3 epochs, I think it overfit and really needed just 2.
Tested in 4-bit and FP16 on plain HF llama-7b, maybe it works on derivative models of the same beaks.
V2 version was trained at a higher rank and logner context (512) on only unique data with ALLMs and "content warning" statements removed. It is much stronger.
- Created
- May 17, 2023
- Updated
- May 21, 2023