Downloads · 30 days
5
10% of all-time downloads
aakarsh-nair/Baby-Llama-58M-Seq-12
Baby-Llama-58M-Seq-12 is a text generation model from aakarsh-nair. Use it when you need the model to write or continue text. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
5
10% of all-time downloads
All-time downloads
51
Public
Parameters
58.3M
234 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors233 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 13.6431 | 1.0 | 1033 | 13.0003 |
| 4.5948 | 2.0 | 2066 | 5.0537 |
| 3.2884 | 3.0 | 3099 | 3.7453 |
| 2.7693 | 4.0 | 4132 | 3.2173 |
| 2.4546 | 5.0 | 5165 | 2.9641 |
| 2.3522 | 6.0 | 6198 | 2.7657 |
| 2.232 | 7.0 | 7231 | 2.7236 |
| 2.117 | 8.0 | 8264 | 2.5361 |
| 2.0658 | 9.0 | 9297 | 2.4256 |
| 1.9785 | 10.0 | 10330 | 2.3703 |
| 1.9123 | 11.0 | 11363 | 2.2645 |
| 1.8826 | 12.0 | 12396 | 2.2197 |
| 1.8313 | 13.0 | 13429 | 2.1459 |
| 1.8022 | 14.0 | 14462 | 2.1489 |
| 1.7861 | 15.0 | 15495 | 2.0834 |
| 1.721 | 16.0 | 16528 | 2.0582 |
| 1.6752 | 17.0 | 17561 | 2.0198 |
| 1.6826 | 18.0 | 18594 | 2.0021 |
| 1.6616 | 19.0 | 19627 | 1.9790 |
| 1.6526 | 20.0 | 20660 | 1.9602 |
| 1.6398 | 21.0 | 21693 | 1.9488 |
| 1.6466 | 22.0 | 22726 | 1.9407 |
| 1.6254 | 23.0 | 23759 | 1.9366 |
| 1.6168 | 24.0 | 24792 | 1.9338 |
| 1.6347 | 25.0 | 25825 | 1.9329 |