Downloads · 30 days
7
14% of all-time downloads
AbdullahHedeya/h4_f1024_l16_d256_no_kd_10_epochs_new
h4_f1024_l16_d256_no_kd_10_epochs_new is a machine learning model from AbdullahHedeya. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
14% of all-time downloads
All-time downloads
49
Public
Parameters
24.5M
98.1 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors98 MB · 99%
From the Hugging Face model README
This model was trained from scratch on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Average Per | Validation Loss | Per Ghonna | Per Hams Or Jahr | Per Istitala | Per Itbaq | Per Phonemes | Per Qalqla | Per Safeer | Per Shidda Or Rakhawa | Per Tafashie | Per Tafkheem Or Taqeeq | Per Tikraar |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2.1346 | 0.6000 | 7279 | 0.1958 | 0.4810 | 0.1024 | 0.1304 | 0.1953 | 0.1592 | 0.1782 | 0.3205 | 0.1340 | 0.1829 | 0.1766 | 0.4285 | 0.1452 |
| 0.3336 | 1.2001 | 14558 | 0.0503 | 0.2327 | 0.0406 | 0.0481 | 0.0216 | 0.0271 | 0.0901 | 0.0376 | 0.0482 | 0.0756 | 0.0249 | 0.1104 | 0.0285 |
| 0.1949 | 1.8001 | 21837 | 0.0338 | 0.1582 | 0.0281 | 0.0297 | 0.0145 | 0.0181 | 0.0597 | 0.0260 | 0.0375 | 0.0493 | 0.0187 | 0.0712 | 0.0189 |
| 0.1409 | 2.4001 | 29116 | 0.0341 | 0.1178 | 0.0290 | 0.0282 | 0.0240 | 0.0257 | 0.0537 | 0.0266 | 0.0355 | 0.0436 | 0.0203 | 0.0671 | 0.0213 |
| 0.1409 | 3.0 | 36393 | 0.0299 | 0.0994 | 0.0263 | 0.0239 | 0.0224 | 0.0225 | 0.0476 | 0.0245 | 0.0295 | 0.0356 | 0.0162 | 0.0609 | 0.0196 |
| 0.0929 | 3.0002 | 36395 | 0.0973 | 0.0463 | 0.0237 | 0.0349 | 0.0609 | 0.0232 | 0.0299 | 0.0249 | 0.0202 | 0.0166 | 0.0229 | 0.0266 | 0.0300 |
| 0.0922 | 3.6002 | 43674 | 0.0787 | 0.0356 | 0.0163 | 0.0252 | 0.0556 | 0.0133 | 0.0221 | 0.0174 | 0.0119 | 0.0105 | 0.0123 | 0.0165 | 0.0215 |
| 0.0778 | 4.2002 | 50953 | 0.0734 | 0.0321 | 0.0141 | 0.0230 | 0.0495 | 0.0098 | 0.0153 | 0.0138 | 0.0097 | 0.0076 | 0.0085 | 0.0137 | 0.0179 |
| 0.0671 | 4.8003 | 58232 | 0.0576 | 0.0236 | 0.0112 | 0.0186 | 0.0621 | 0.0078 | 0.0111 | 0.0127 | 0.0077 | 0.0065 | 0.0067 | 0.0115 | 0.0163 |
| 0.0671 | 5.0 | 60655 | 0.0561 | 0.0261 | 0.0167 | 0.0222 | 0.0608 | 0.0154 | 0.0161 | 0.0179 | 0.0147 | 0.0125 | 0.0147 | 0.0185 | 0.0214 |