Downloads · 30 days
5
15% of all-time downloads
sst5-gpt2-kd
kennethge123/sst5-gpt2-kd
sst5-gpt2-kd is a machine learning model from kennethge123. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as mit.
All-time downloads
33
Public
Repo size
5.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin498 MB · 100%
At a glance
- Library
- pytorch
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Mar 29, 2024
- Updated
- Mar 30, 2024
- SHA
- 139b5387
Model card
From the Hugging Face model README
Plainly Optimized Network
Dataset: BIGBENCH
Trainer Hyperparameters:
lr= 5e-05per_device_batch_size= 1gradient_accumulation_steps= 4weight_decay= 1e-09seed= 42
| eval_loss | eval_mse | epoch |
|---|---|---|
| 58.741 | 0.055 | 1.0 |
| 60.624 | 0.058 | 2.0 |
| 60.765 | 0.057 | 3.0 |
| 55.858 | 0.051 | 4.0 |
| 57.271 | 0.053 | 5.0 |
| 56.004 | 0.051 | 6.0 |
| 60.246 | 0.056 | 7.0 |
| 55.218 | 0.049 | 8.0 |
| 55.261 | 0.049 | 9.0 |
| 54.730 | 0.049 | 10.0 |
| 58.137 | 0.052 | 11.0 |
| 53.927 | 0.048 | 12.0 |
| 56.143 | 0.051 | 13.0 |
| 54.604 | 0.049 | 14.0 |
| 53.596 | 0.048 | 15.0 |
| 54.241 | 0.049 | 16.0 |
| 55.500 | 0.050 | 17.0 |
| 53.256 | 0.047 | 18.0 |
| 53.139 | 0.047 | 19.0 |
- Library
- pytorch
- Type
- gpt2
- License
- mit
- Languages
- en
- Created
- Mar 29, 2024
- Updated
- Mar 30, 2024