Downloads · 30 days
13
24% of all-time downloads
QLoRA_test3
WQchoi/QLoRA_test3
QLoRA_test3 is a text generation model from WQchoi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
args=TrainingArguments( outputdir="C:/Users/tjrja/OneDrive/바탕 화면/finet/checkpoint4", loadbestmodelatend=True, autofindbatchsize=True, gradientaccumulationsteps=1, warmupratio=0.1, numtrainepochs=10, learningrate=1e-4,…
All-time downloads
55
Public
Parameters
6.9B
27.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 16, 2024
- Updated
- Jan 19, 2024
- SHA
- cb19f39c
Model card
From the Hugging Face model README
args=TrainingArguments( output_dir="C:/Users/tjrja/OneDrive/바탕 화면/finet/checkpoint4", load_best_model_at_end=True, auto_find_batch_size=True, gradient_accumulation_steps=1, warmup_ratio=0.1, num_train_epochs=10, learning_rate=1e-4, max_grad_norm=0.5, weight_decay=0.0001, fp16=True, optim="paged_adamw_32bit", lr_scheduler_type="constant", logging_steps=264, evaluation_strategy="epoch", eval_steps=1, save_strategy="epoch", save_steps=10, )
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- ko
- Created
- Jan 16, 2024
- Updated
- Jan 19, 2024