Downloads · 30 days
0
autobots/llama_7b_roleplay_lora
llama_7b_roleplay_lora is a machine learning model from autobots. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Roleplay Lora trained on llama-7b in 4-bit mode.
Downloads · 30 days
0
Access
Public
Updated May 13, 2023
Repo size
67.2 MB
Likes
0
Public
Click a slice to open those files.
.bin67.2 MB · 100%
From the Hugging Face model README
Roleplay Lora trained on llama-7b in 4-bit mode.
Trained for 3 epochs.
uses the https://github.com/teknium1/GPTeacher/tree/main/Roleplay dataset
Training in 4bit is very fast.. only took 1/2 hour on a 3090. Eval against the dataset gave a 3.x perpelexity.