Downloads · 30 days
8
40% of all-time downloads
mrm8488_-_spanish-gpt2-4bits
RichardErkhov/mrm8488_-_spanish-gpt2-4bits
mrm8488_-_spanish-gpt2-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
20
Public
Parameters
126M
127 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors127 MB · 97%
Parameter types
How the weights are stored.
U884.9M · 68%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
spanish-gpt2 - bnb 4bits
- Model creator: https://huggingface.co/mrm8488/
- Original model: https://huggingface.co/mrm8488/spanish-gpt2/
Original model description:
language: es tags:
- GPT-2 datasets:
- large_spanish_corpus widgets:
- text: "Érase un vez un"
license: mit
Spanish GPT-2 trained on large_spanish_corpus
This is a Spanish GPT-2 model trained from scratch on the large_spanish_corpus aka BETO's corpus with Flax This is part of the Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google.
Dataset
The dataset is about 20 GB. 95% of the data was used for training and the rest 5% for validation.
Metrics (on evaluation dataset)
- Loss: 2.413
- Perplexity: 11.36
Team members
- Manuel Romero (mrm8488)
- María Grandury (mariagrandury)
- Pablo González de Prado (Pablogps)
- Daniel Vera (daveni)
- Sri Lakshmi (srisweet)
- José Posada (jdposa)
- Santiago Hincapie (shpotes)
- Jorge (jorgealro)
Useful links
- Type
- gpt2
- Created
- Oct 18, 2024
- Updated
- Oct 18, 2024