Downloads · 30 days
0
Neko-Institute-of-Science/VicUnLocked-30b-LoRA
VicUnLocked-30b-LoRA is a machine learning model from Neko-Institute-of-Science. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
https://github.com/practicaldreamer/vicunatoalpaca
Downloads · 30 days
0
Access
Public
Updated Jun 24, 2023
Repo size
3.7 GB
Likes
17
Public
Click a slice to open those files.
.bin3.7 GB · 100%
From the Hugging Face model README
https://github.com/practicaldreamer/vicuna_to_alpaca
https://github.com/oobabooga/text-generation-webui
ATM I'm using 2023.05.04v0 of the dataset and training full context.
So I will only be training 1 epoch, as full context 30b takes so long to train. This 1 epoch will take me 8 days lol but luckily these LoRA feels fully functinal at epoch 1 as shown on my 13b one. Also I will be uploading checkpoints almost everyday. I could train another epoch if there's enough want for it.
Update: Since I will not be training over 1 epoch @Aeala is training for the full 3 https://huggingface.co/Aeala/VicUnlocked-alpaca-half-30b-LoRA but it's half ctx if you care about that. Also @Aeala's just about done.
Update: Training Finished at Epoch 1, These 8 days sure felt long. I only have one A6000 lads there's only so much I can do. Also RIP gozfarb IDK what happened to him.
python server.py --listen --model LLaMA-30B-HF --load-in-8bit --chat --lora VicUnLocked-30b-LoRA