Downloads · 30 days
36
6% of all-time downloads
GPT-2-agriparts
Gan1108/GPT-2-agriparts
GPT-2-agriparts is a text generation model from Gan1108. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is a fine-tuned version of malteos/gpt2-uk on Gan1108/agriparts dataset. It achieves the following results on the evaluation set: - Loss: 0.8610
All-time downloads
573
Public
Parameters
124M
48.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors789 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt2
- Access
- Public
- Created
- Feb 13, 2024
- Updated
- Mar 27, 2024
- SHA
- 3c152866
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
agriparts-4
This model is a fine-tuned version of malteos/gpt2-uk on Gan1108/agriparts dataset. It achieves the following results on the evaluation set:
- Loss: 0.8610
Model description
The model is trained to generate a text description in Ukrainian of spare parts for agricultural machinery based on their name.
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3.0
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.1912 | 1.0 | 1340 | 0.9919 |
| 0.9461 | 2.0 | 2680 | 0.8901 |
| 0.8646 | 3.0 | 4020 | 0.8610 |
Framework versions
- Transformers 4.37.2
- Pytorch 2.1.2+cu121
- Datasets 2.16.1
- Tokenizers 0.15.1
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Languages
- uk
- Created
- Feb 13, 2024
- Updated
- Mar 27, 2024