Downloads · 30 days
0
t5like-60M
bri25yu/t5like-60M
t5like-60M is a machine learning model from bri25yu. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Access
Public
Updated Jun 10, 2023
Repo size
1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt847 MB · 75%
At a glance
- Access
- Public
- Created
- Jun 10, 2023
- Updated
- Jun 10, 2023
- SHA
- 779316b2
Model card
From the Hugging Face model README
| Hyperparameter | Value |
|---|---|
| Steps | 150k |
| Max length | 256 |
| LR | 1e-4 |
| LR schedule | constant |
| Optimizer | AdamW |
| beta_1, beta_2 | 0.9, 0.95 |
| Final eval loss | 2.245 |
| Final eval perplexity | 9.44 |
- Languages
- en
- Created
- Jun 10, 2023
- Updated
- Jun 10, 2023