Downloads · 30 days
1.5K
2% of all-time downloads
gpt-2-spanish
flax-community/gpt-2-spanish
gpt-2-spanish is a text generation model from flax-community. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
GPT-2 model trained from scratch on the Spanish portion of OSCAR. The model is trained with Flax and using TPUs sponsored by Google since this is part of the Flax/Jax Community Week
All-time downloads
93.2K
Public
Parameters
137M
2.1 GB on disk
Likes
29
Public
Repo makeup
Click a slice to open those files.
.bin510 MB · 33%
Parameter types
How the weights are stored.
F32124M · 91%
Datasets
Model card
From the Hugging Face model README
Spanish GPT-2
GPT-2 model trained from scratch on the Spanish portion of OSCAR. The model is trained with Flax and using TPUs sponsored by Google since this is part of the Flax/Jax Community Week organised by HuggingFace.
Model description
The model used for training is OpenAI's GPT-2, introduced in the paper "Language Models are Unsupervised Multitask Learners" by Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei and Ilya Sutskever.
This model is available in the 🤗 Model Hub.
Training data
Spanish portion of OSCAR or Open Super-large Crawled ALMAnaCH coRpus, a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.
This corpus is available in the 🤗 Datasets library.
Team members
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- apache-2.0
- Languages
- es
- Created
- Mar 2, 2022
- Updated
- Apr 1, 2024