Downloads · 30 days
5
33% of all-time downloads
7b-lora
googcheng/7b-lora
7b-lora is a machine learning model from googcheng. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
模型功能: 古诗句接龙 based on baichuan-inc/Baichuan-7B
All-time downloads
15
Public
Repo size
16.9 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin16.8 MB · 97%
At a glance
- Library
- peft
- Access
- Public
- Created
- Jul 31, 2023
- Updated
- Aug 18, 2023
- SHA
- 9ba17999
Model card
From the Hugging Face model README
模型功能: 古诗句接龙 based on baichuan-inc/Baichuan-7B
Training procedure
CUDA_VISIBLE_DEVICES=0 python src/train_bash.py --stage sft --model_name_or_path baichuan-inc/Baichuan-7B --do_train --dataset alpaca_gpt4_zh --template default --finetuning_type lora --output_dir path_to_sft_checkpoint --overwrite_cache --per_device_train_batch_size 4 --gradient_accumulation_steps 4 --lr_scheduler_type cosine --logging_steps 10 --save_steps 1000 --learning_rate 5e-5 --num_train_epochs 20 --plot_loss --fp16 --lora_target W_pack
Framework versions
- PEFT 0.4.0
Test
- Library
- peft
- Created
- Jul 31, 2023
- Updated
- Aug 18, 2023