Downloads · 30 days
20
1% of all-time downloads
convbert-base-spanish
mrm8488/convbert-base-spanish
convbert-base-spanish is a feature extraction model from mrm8488. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
The ConvBERT architecture is presented in the "ConvBERT: Improving BERT with Span-based Dynamic Convolution" paper.
All-time downloads
2.2K
Public
Repo size
1.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.h5423 MB · 50%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- mit
- Model type
- convbert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Aug 13, 2021
- SHA
- 81f73125
Datasets
Model card
From the Hugging Face model README
ConvBERT base pre-trained on large_spanish_corpus
The ConvBERT architecture is presented in the "ConvBERT: Improving BERT with Span-based Dynamic Convolution" paper.
Metrics on evaluation set
disc_accuracy = 0.9488542
disc_auc = 0.8833056
disc_loss = 0.15933733
disc_precision = 0.79224133
disc_recall = 0.27443287
global_step = 1000000
loss = 9.658503
masked_lm_accuracy = 0.6177698
masked_lm_loss = 1.7050561
sampled_masked_lm_accuracy = 0.5379228
Usage
from transformers import AutoModel, AutoTokenizer
model_name = "mrm8488/convbert-base-spanish"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModel.from_pretrained(model_name)
Created by Manuel Romero/@mrm8488 with the support of Narrativa
Made with <span style="color: #e25555;">♥</span> in Spain
- Task
- Feature Extraction
- Library
- transformers
- Type
- convbert
- License
- mit
- Languages
- es
- Created
- Mar 2, 2022
- Updated
- Aug 13, 2021