Downloads · 30 days
5
25% of all-time downloads
flax-community_-_gpt-2-spanish-4bits
RichardErkhov/flax-community_-_gpt-2-spanish-4bits
flax-community_-_gpt-2-spanish-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
20
Public
Parameters
126M
127 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors127 MB · 97%
Parameter types
How the weights are stored.
U884.9M · 68%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
gpt-2-spanish - bnb 4bits
- Model creator: https://huggingface.co/flax-community/
- Original model: https://huggingface.co/flax-community/gpt-2-spanish/
Original model description:
language: es tags:
- text-generation datasets:
- oscar widgets:
- text: 'Érase un vez '
- text: >- Frase: Esta película es muy agradable. Sentimiento: positivo Frase: Odiaba esta película, apesta. Sentimiento: negativo Frase: Esta película fue bastante mala. Sentimiento: license: apache-2.0
Spanish GPT-2
GPT-2 model trained from scratch on the Spanish portion of OSCAR. The model is trained with Flax and using TPUs sponsored by Google since this is part of the Flax/Jax Community Week organised by HuggingFace.
Model description
The model used for training is OpenAI's GPT-2, introduced in the paper "Language Models are Unsupervised Multitask Learners" by Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei and Ilya Sutskever.
This model is available in the 🤗 Model Hub.
Training data
Spanish portion of OSCAR or Open Super-large Crawled ALMAnaCH coRpus, a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.
This corpus is available in the 🤗 Datasets library.
Team members
- Type
- gpt2
- Created
- Oct 11, 2024
- Updated
- Oct 11, 2024