Downloads · 30 days
0
Alpaca-LoRA-30B-elina
LLMs/Alpaca-LoRA-30B-elina
Alpaca-LoRA-30B-elina is a text generation model from LLMs. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is LoRA checkpoint fine-tuned with the following CLI. The fine-tuning process is logged in W&B dashboard. I have used DGX workstation with 8 x A100(40G).
Access
Public
Updated Apr 30, 2023
Repo size
205 MB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.bin205 MB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Apr 26, 2023
- Updated
- Apr 30, 2023
- SHA
- aeae75d4
Try a prompt
Model card
From the Hugging Face model README
This is LoRA checkpoint fine-tuned with the following CLI. The fine-tuning process is logged in W&B dashboard. I have used DGX workstation with 8 x A100(40G).
python finetune.py \
--base_model='elinas/llama-30b-hf-transformers-4.29' \
--data_path='alpaca_data.json' \
--num_epochs=10 \
--cutoff_len=1024 \
--group_by_length \
--output_dir='./lora-alpaca-30b-elinas' \
--lora_target_modules='[q_proj,k_proj,v_proj,o_proj]' \
--lora_r=16 \
--lora_alpha=32 \
--batch_size=1024 \
--micro_batch_size=20
This LoRA checkpoint is recommended to be used with transformers >= 4.29 which should be installed with the following command currently(4/30/2023).
pip install git+https://github.com/huggingface/transformers.git
- Task
- Text Generation
- License
- apache-2.0
- Created
- Apr 26, 2023
- Updated
- Apr 30, 2023