Downloads · 30 days
830
1% of all-time downloads
spanish-gpt2
mrm8488/spanish-gpt2
spanish-gpt2 is a text generation model from mrm8488. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is a Spanish GPT-2 model trained from scratch on the largespanishcorpus aka BETO's corpus with Flax This is part of the Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google.
All-time downloads
73K
Public
Parameters
137M
9.6 GB on disk
Likes
20
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 33%
Parameter types
How the weights are stored.
F32124M · 91%
Datasets
Model card
From the Hugging Face model README
Spanish GPT-2 trained on large_spanish_corpus
This is a Spanish GPT-2 model trained from scratch on the large_spanish_corpus aka BETO's corpus with Flax This is part of the Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google.
Dataset
The dataset is about 20 GB. 95% of the data was used for training and the rest 5% for validation.
Metrics (on evaluation dataset)
- Loss: 2.413
- Perplexity: 11.36
Team members
- Manuel Romero (mrm8488)
- María Grandury (mariagrandury)
- Pablo González de Prado (Pablogps)
- Daniel Vera (daveni)
- Sri Lakshmi (srisweet)
- José Posada (jdposa)
- Santiago Hincapie (shpotes)
- Jorge (jorgealro)
Useful links
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Languages
- es
- Created
- Mar 2, 2022
- Updated
- Mar 19, 2023