Downloads · 30 days
0
UofA-LINGO/text-to-triplets-explanation-v3
text-to-triplets-explanation-v3 is a machine learning model from UofA-LINGO. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
LoRA weights for lmsys/vicuna-7b-delta-v0
Downloads · 30 days
0
Access
Public
Updated Jun 17, 2023
Repo size
33.6 MB
Likes
0
Public
Click a slice to open those files.
.bin33.6 MB · 100%
From the Hugging Face model README
LoRA weights for lmsys/vicuna-7b-delta-v0
Trained on 'taesiri/webnlg-triplets-explanation-v1' for 4 epochs.
Command:
WORLD_SIZE=2 CUDA_VISIBLE_DEVICES=0,1 torchrun --nproc_per_node=2 --master_port=1234 finetune.py --base_model='./checkpoints/lmsys-vicuna-7B-HF' --data_path 'taesiri/webnlg-triplets-explanation-v1' --num_epochs=4 --cutoff_len=512 --group_by_length --lora_target_modules='[q_proj,k_proj,v_proj,o_proj]' --lora_r=8 --micro_batch_size=8 --batch_size=32