Downloads · 30 days
14
1% of all-time downloads
bertin-base-paws-x-es
bertin-project/bertin-base-paws-x-es
bertin-base-paws-x-es is a text classification model from bertin-project. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as cc-by-4.0.
This checkpoint has been trained for the PAWS-X task using the CoNLL 2002-es dataset.
All-time downloads
1.4K
Public
Parameters
125M
997 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin499 MB · 50%
Parameter types
How the weights are stored.
F32125M · 100%
Try a prompt
Model card
From the Hugging Face model README
This checkpoint has been trained for the PAWS-X task using the CoNLL 2002-es dataset.
This checkpoint was created from Bertin Gaussian 512, which is a RoBERTa-base model trained from scratch in Spanish. Information on this base model may be found at its own card and at deeper detail on the main project card.
The training dataset for the base model is mc4 subsampling documents to a total of about 50 million examples. Sampling is biased towards average perplexity values (using a Gaussian function), discarding more often documents with very large values (poor quality) of very small values (short, repetitive texts).
This is part of the Flax/Jax Community Week, organised by HuggingFace and TPU usage sponsored by Google.
Team members
- Task
- Text Classification
- Library
- transformers
- Type
- roberta
- License
- cc-by-4.0
- Languages
- es
- Created
- Mar 2, 2022
- Updated
- Mar 21, 2023