Downloads · 30 days
21
4% of all-time downloads
gemma-2-2b-id-inst
dwikitheduck/gemma-2-2b-id-inst
gemma-2-2b-id-inst is a machine learning model from dwikitheduck. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
All-time downloads
486
Public
Repo size
10.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin5.2 GB · 50%
At a glance
- License
- gemma
- Model type
- gemma2
- Access
- Public
- Created
- Oct 24, 2024
- Updated
- Oct 25, 2024
- SHA
- 1c046ade
Model card
From the Hugging Face model README
Experiment 1 SFT ALPACA INDO
dataset: 9 millions token indo alpaca dataset
max_seq_length = 8192, dataset_num_proc = 2, packing = False, args = TrainingArguments( per_device_train_batch_size = 1, gradient_accumulation_steps = 8, warmup_steps = 5, num_train_epochs = 1, learning_rate = 5e-5, fp16 = not is_bfloat16_supported(), bf16 = is_bfloat16_supported(), logging_steps = 1, optim = "adamw_8bit", weight_decay = 0.01, lr_scheduler_type = "linear", seed = 3407,
- Type
- gemma2
- License
- gemma
- Created
- Oct 24, 2024
- Updated
- Oct 25, 2024