Downloads · 30 days
5
9% of all-time downloads
tiendung/vietmistral_enbagel_lora-ctx4096-cpt3000
vietmistral_enbagel_lora-ctx4096-cpt3000 is a text generation model from tiendung. Use it when you need the model to write or continue text. It is set up for transformers.
data enbagel.jsonl.zst, 160k english instructs, 378M
Downloads · 30 days
5
9% of all-time downloads
All-time downloads
57
Public
Repo size
14.7 GB
Likes
0
Public
Click a slice to open those files.
.safetensors14.6 GB · 99%
From the Hugging Face model README
data enbagel.jsonl.zst, 160k english instructs, 378M
{'loss': 0.6286, 'learning_rate': 5.076582709326072e-05, 'epoch': 1.0}
{'loss': 0.6117, 'learning_rate': 5.074880871341049e-05, 'epoch': 1.0}
{'loss': 0.4023, 'learning_rate': 5.073179033356025e-05, 'epoch': 1.0}
{'loss': 0.7861, 'learning_rate': 5.071477195371e-05, 'epoch': 1.0}
{'loss': 0.5591, 'learning_rate': 5.069775357385977e-05, 'epoch': 1.0}
{'loss': 0.5298, 'learning_rate': 5.0680735194009535e-05, 'epoch': 1.0}
{'loss': 0.7576, 'learning_rate': 5.066371681415929e-05, 'epoch': 1.0}
{'loss': 0.6725, 'learning_rate': 5.064669843430906e-05, 'epoch': 1.0}
{'loss': 0.4667, 'learning_rate': 5.062968005445882e-05, 'epoch': 1.0}
51%|█████ | 3000/5936 [12:06:13<11:35:20, 14.21s/it]finetune_qlora_vietmistra.sh: line 33: 91840 Killed