Downloads · 30 days
0
llamaLightNovel
Snowad/llamaLightNovel
llamaLightNovel is a machine learning model from Snowad. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This repo is my fine tuned lora of Llama on the first 4 volumes of Eminence in shadow and konosuba to test its ability to record new information. The training used alpaca-lora on a 3090 for 10 hours with : - Micro Bat…
Access
Public
Updated Mar 29, 2023
Repo size
2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.zip1.5 GB · 73%
At a glance
- License
- other
- Access
- Public
- Created
- Mar 29, 2023
- Updated
- Mar 29, 2023
- SHA
- 4f3c301f
Model card
From the Hugging Face model README
This repo is my fine tuned lora of Llama on the first 4 volumes of Eminence in shadow and konosuba to test its ability to record new information. The training used alpaca-lora on a 3090 for 10 hours with :
- Micro Batch Size 2,
- batch size 64,
- 35 epochs,
- 3e-4 learning rate,
- lora rank 256,
- 512 lora alpha,
- 0.05 lora dropout,
- 352 cutoff
- License
- other
- Languages
- en
- Created
- Mar 29, 2023
- Updated
- Mar 29, 2023