Downloads · 30 days
254
6% of all-time downloads
dbmdz/electra-base-french-europeana-cased-discriminator
electra-base-french-europeana-cased-discriminator is a machine learning model from dbmdz. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
In this repository the MDZ Digital Library team (dbmdz) at the Bavarian State Library open sources French Europeana ELECTRA models 🎉
Downloads · 30 days
254
6% of all-time downloads
All-time downloads
4K
Public
Parameters
111M
1.3 GB on disk
Likes
1
Public
Click a slice to open those files.
.h5443 MB · 33%
How the weights are stored.
F32111M · 100%
From the Hugging Face model README
In this repository the MDZ Digital Library team (dbmdz) at the Bavarian State Library open sources French Europeana ELECTRA models 🎉
We extracted all French texts using the language metadata attribute from the Europeana corpus.
The resulting corpus has a size of 63GB and consists of 11,052,528,456 tokens.
Based on the metadata information, texts from the 18th - 20th century are mainly included in the training corpus.
Detailed information about the data and pretraining steps can be found in this repository.
ELECTRA model weights for PyTorch and TensorFlow are available.
dbmdz/electra-base-french-europeana-cased-discriminator - model hub pagedbmdz/electra-base-french-europeana-cased-generator - model hub pageFor results on Historic NER, please refer to this repository.
With Transformers >= 2.3 our French Europeana ELECTRA model can be loaded like:
from transformers import AutoModel, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("dbmdz/electra-base-french-europeana-cased-discriminator")
model = AutoModel.from_pretrained("dbmdz/electra-base-french-europeana-cased-discriminator")
All models are available on the Huggingface model hub.
For questions about our ELECTRA models just open an issue here 🤗
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
Thanks to the generous support from the Hugging Face team, it is possible to download our models from their S3 storage 🤗