Downloads · 30 days
0
Llama-2-7b-peft-1
B20274/Llama-2-7b-peft-1
Llama-2-7b-peft-1 is a machine learning model from B20274. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
First version of llama-2 "NousResearch/Llama-2-7b-hf" finetuned for LMSYS Kaggle competition. trainingargs = TrainingArguments( outputdir="./results", numtrainepochs=CFG.epochs, perdevicetrainbatchsize=CFG.batchsize,…
Access
Public
Updated Jun 22, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
Other1.5 KB · 71%
At a glance
- Access
- Public
- Created
- Jun 22, 2024
- Updated
- Jun 22, 2024
- SHA
- 9540ca5e
Model card
From the Hugging Face model README
First version of llama-2 "NousResearch/Llama-2-7b-hf" finetuned for LMSYS Kaggle competition. training_args = TrainingArguments( output_dir="./results", num_train_epochs=CFG.epochs, per_device_train_batch_size=CFG.batch_size, per_device_eval_batch_size=CFG.batch_size, gradient_accumulation_steps=1, eval_strategy="steps", eval_steps=1000, logging_steps=1, optim="paged_adamw_8bit", learning_rate=2e-4, lr_scheduler_type="linear", warmup_steps=10, #fp16=True, gradient_checkpointing=True, report_to="wandb", )
- Created
- Jun 22, 2024
- Updated
- Jun 22, 2024