Downloads · 30 days
86
2% of all-time downloads
gpt2-wiki2
irodkin/gpt2-wiki2
gpt2-wiki2 is a text generation model from irodkin. Use it when you need the model to write or continue text. It is set up for transformers.
metrics on 1024 context: - validperplexity = 14.79 - validcrossentropy = 2.69 - trainperplexity = 13.77 - traincrossentropy = 2.62
All-time downloads
4.1K
Public
Parameters
124M
11.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin498 MB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Sep 7, 2023
- Updated
- Jun 1, 2025
- SHA
- 48aedb6a
Try a prompt
Datasets
Model card
From the Hugging Face model README
metrics on 1024 context:
- valid_perplexity = 14.79
- valid_cross_entropy = 2.69
- train_perplexity = 13.77
- train_cross_entropy = 2.62
metrics on 252 context:
- valid_perplexity = 17.35
metrics on 378 context:
- valid_perplexity = 16.4
metrics on 504 context:
- valid_perplexity = 15.86
Dependence of the cross entropy loss on the length of the context for prediction
- x-axis*128 = context length
- y-axis = cross entropy
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Languages
- en
- Created
- Sep 7, 2023
- Updated
- Jun 1, 2025