Downloads · 30 days
15
23% of all-time downloads
jinx2321/byt5-base-ko-1e4-jit-20epochs-a100-jamoparams-wu2000-rm1-bs2-ga64-eb128-distilled-small-7
byt5-base-ko-1e4-jit-20epochs-a100-jamoparams-wu2000-rm1-bs2-ga64-eb128-distilled-small-7 is a machine learning model from jinx2321. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
15
23% of all-time downloads
All-time downloads
65
Public
Parameters
5.6M
44.9 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors22.5 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of google/byt5-small on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 3.8885 | 1.0 | 1253 | 2.9699 |
| 2.0499 | 2.0 | 2506 | 2.0679 |
| 1.5599 | 3.0 | 3759 | 1.5691 |
| 1.2942 | 4.0 | 5012 | 1.2959 |
| 1.1866 | 5.0 | 6265 | 1.2026 |
| 1.1382 | 6.0 | 7518 | 1.1570 |
| 1.1029 | 7.0 | 8771 | 1.1349 |
| 1.0837 | 8.0 | 10024 | 1.1134 |
| 1.0653 | 9.0 | 11277 | 1.1015 |
| 1.0565 | 10.0 | 12530 | 1.0912 |
| 1.0423 | 11.0 | 13783 | 1.0850 |
| 1.0359 | 12.0 | 15036 | 1.0799 |
| 1.0292 | 13.0 | 16289 | 1.0726 |
| 1.0235 | 14.0 | 17542 | 1.0705 |
| 1.0165 | 15.0 | 18795 | 1.0687 |
| 1.0172 | 16.0 | 20048 | 1.0642 |
| 1.0084 | 17.0 | 21301 | 1.0625 |
| 1.0079 | 18.0 | 22554 | 1.0637 |
| 1.0058 | 19.0 | 23807 | 1.0582 |
| 1.0028 | 20.0 | 25060 | 1.0576 |
| 0.9978 | 21.0 | 26313 | 1.0583 |
| 0.9991 | 22.0 | 27566 | 1.0564 |
| 0.9934 | 23.0 | 28819 | 1.0551 |
| 0.9914 | 24.0 | 30072 | 1.0529 |
| 0.9905 | 25.0 | 31325 | 1.0521 |
| 0.992 | 26.0 | 32578 | 1.0537 |
| 0.9901 | 27.0 | 33831 | 1.0521 |
| 0.9852 | 28.0 | 35084 | 1.0511 |
| 0.9846 | 29.0 | 36337 | 1.0509 |
| 0.9846 | 30.0 | 37590 | 1.0494 |
| 0.9845 | 31.0 | 38843 | 1.0501 |
| 0.9814 | 32.0 | 40096 | 1.0498 |
| 0.9801 | 33.0 | 41349 | 1.0490 |
| 0.9804 | 34.0 | 42602 | 1.0480 |
| 0.979 | 35.0 | 43855 | 1.0477 |
| 0.9783 | 36.0 | 45108 | 1.0481 |
| 0.978 | 37.0 | 46361 | 1.0487 |
| 0.9753 | 38.0 | 47614 | 1.0473 |
| 0.9748 | 39.0 | 48867 | 1.0473 |
| 0.9748 | 40.0 | 50120 | 1.0463 |