Downloads · 30 days
4
22% of all-time downloads
cypher-7b-apoc2
guilleguells/cypher-7b-apoc2
cypher-7b-apoc2 is a machine learning model from guilleguells. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
All-time downloads
18
Public
Repo size
18.9 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin18.9 MB · 100%
At a glance
- Library
- peft
- Access
- Public
- Created
- Jul 15, 2023
- Updated
- Jul 17, 2023
- SHA
- fbc7445c
Model card
From the Hugging Face model README
Settings
training_args = transformers.TrainingArguments( auto_find_batch_size=True, gradient_accumulation_steps=4, num_train_epochs=1, learning_rate=2e-4, fp16=True, save_total_limit=3, logging_steps=1, max_steps=80, output_dir="/home/gguells/finetuning/apoc/", save_strategy='epoch', optim="paged_adamw_8bit", lr_scheduler_type = 'cosine', warmup_ratio = 0.05, )
- Library
- peft
- Created
- Jul 15, 2023
- Updated
- Jul 17, 2023