Downloads · 30 days
16
0% of all-time downloads
convbert-small-igc-is
jonfd/convbert-small-igc-is
convbert-small-igc-is is a feature extraction model from jonfd. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as cc-by-4.0.
This model was pretrained on the Icelandic Gigaword Corpus, which contains approximately 1.69B tokens, using default settings. The model uses a Unigram tokenizer with a vocabulary size of 96,000.
All-time downloads
58.7K
Public
Repo size
259 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.h586.4 MB · 48%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- cc-by-4.0
- Model type
- convbert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Oct 1, 2021
- SHA
- d10ea3ad
Datasets
Model card
From the Hugging Face model README
Icelandic ConvBERT-Small
This model was pretrained on the Icelandic Gigaword Corpus, which contains approximately 1.69B tokens, using default settings. The model uses a Unigram tokenizer with a vocabulary size of 96,000.
Acknowledgments
This research was supported with Cloud TPUs from Google's TPU Research Cloud (TRC).
This project was funded by the Language Technology Programme for Icelandic 2019-2023. The programme, which is managed and coordinated by Almannarómur, is funded by the Icelandic Ministry of Education, Science and Culture.
- Task
- Feature Extraction
- Library
- transformers
- Type
- convbert
- License
- cc-by-4.0
- Languages
- is
- Created
- Mar 2, 2022
- Updated
- Oct 1, 2021