Downloads · 30 days
19
66% of all-time downloads
finetuned_byT5large_per
Tsedeniya/finetuned_byT5large_per
finetuned_byT5large_per is a machine learning model from Tsedeniya. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
All-time downloads
29
Public
Parameters
1.2B
4.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.9 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- t5
- Access
- Public
- Created
- Oct 11, 2026
- Updated
- Oct 11, 2026
- SHA
- 6180b7a9
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
finetuned_byT5large_per
This model is a fine-tuned version of google/byt5-large on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 2.5960
- Chrf++: 15.8106
- Gen Len: 109.5
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 2
- eval_batch_size: 4
- seed: 9349
- gradient_accumulation_steps: 8
- total_train_batch_size: 16
- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 100
Training results
| Training Loss | Epoch | Step | Validation Loss | Chrf++ | Gen Len |
|---|---|---|---|---|---|
| 50.9614 | 1.95 | 78 | 2.4509 | 2.0359 | 189.7647 |
| 42.0761 | 3.9 | 156 | 2.1698 | 2.0544 | 126.7353 |
| 23.9046 | 5.85 | 234 | 1.9431 | 13.7529 | 88.7647 |
| 13.4032 | 7.8 | 312 | 1.5761 | 18.9531 | 110.3529 |
| 13.4032 | 9.75 | 390 | 1.4821 | 19.9322 | 110.8235 |
| 8.4177 | 11.7 | 468 | 1.4545 | 20.9512 | 129.2941 |
| 5.5855 | 13.65 | 546 | 1.5558 | 20.5511 | 133.3824 |
| 3.1006 | 15.6 | 624 | 1.6142 | 21.3202 | 134.3824 |
| 2.1132 | 17.55 | 702 | 1.6934 | 21.4283 | 122.1176 |
| 2.1132 | 19.5 | 780 | 1.8629 | 20.6504 | 139.5294 |
| 1.7033 | 21.45 | 858 | 1.9502 | 21.5898 | 133.8824 |
| 0.9874 | 23.4 | 936 | 1.9683 | 19.1448 | 127.7941 |
| 0.5389 | 25.35 | 1014 | 2.0348 | 20.7494 | 131.9412 |
| 0.5389 | 27.3 | 1092 | 2.2492 | 18.0028 | 132.8235 |
| 0.4235 | 29.25 | 1170 | 2.2692 | 18.6234 | 139.5588 |
| 0.3638 | 31.2 | 1248 | 2.4356 | 17.4547 | 112.9412 |
| 0.2753 | 33.15 | 1326 | 2.3608 | 18.253 | 124.3235 |
| 0.2423 | 35.1 | 1404 | 2.4195 | 17.8487 | 128.2941 |
| 0.2423 | 37.05 | 1482 | 2.4365 | 18.5526 | 130.1471 |
| 0.2323 | 39.0 | 1560 | 2.3525 | 17.7316 | 113.8235 |
| 0.2437 | 40.95 | 1638 | 2.2817 | 17.0584 | 120.7647 |
| 0.2946 | 42.9 | 1716 | 2.0684 | 17.0487 | 122.8824 |
| 0.2946 | 44.85 | 1794 | 2.4445 | 17.5759 | 108.8529 |
| 0.2282 | 46.8 | 1872 | 2.4601 | 16.9786 | 111.2353 |
| 0.1726 | 48.75 | 1950 | 2.4314 | 16.3828 | 103.7941 |
| 0.2017 | 50.7 | 2028 | 2.5960 | 15.8106 | 109.5 |
Framework versions
- Transformers 5.5.0
- Pytorch 2.12.1+cu130
- Datasets 4.3.0
- Tokenizers 0.22.2
- Library
- transformers
- Type
- t5
- License
- apache-2.0
- Created
- Oct 11, 2026
- Updated
- Oct 11, 2026