Downloads · 30 days
30
0% of all-time downloads
GigaBERT-v3-Arabic-and-English
lanwuwei/GigaBERT-v3-Arabic-and-English
GigaBERT-v3-Arabic-and-English is a feature extraction model from lanwuwei. Use it when you need embeddings to search or compare text. It is set up for transformers.
GigaBERT-v3 is a customized bilingual BERT for English and Arabic. It was pre-trained in a large-scale corpus (Gigaword+Oscar+Wikipedia) with ~10B tokens, showing state-of-the-art zero-shot transfer performance from E…
All-time downloads
29.2K
Public
Repo size
1.5 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.bin500 MB · 50%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jan 8, 2023
- SHA
- 51684ebb
Model card
From the Hugging Face model README
GigaBERT-v3
GigaBERT-v3 is a customized bilingual BERT for English and Arabic. It was pre-trained in a large-scale corpus (Gigaword+Oscar+Wikipedia) with ~10B tokens, showing state-of-the-art zero-shot transfer performance from English to Arabic on information extraction (IE) tasks. More details can be found in the following paper:
@inproceedings{lan2020gigabert,
author = {Lan, Wuwei and Chen, Yang and Xu, Wei and Ritter, Alan},
title = {An Empirical Study of Pre-trained Transformers for Arabic Information Extraction},
booktitle = {Proceedings of The 2020 Conference on Empirical Methods on Natural Language Processing (EMNLP)},
year = {2020}
}
Usage
from transformers import *
tokenizer = BertTokenizer.from_pretrained("lanwuwei/GigaBERT-v3-Arabic-and-English", do_lower_case=True)
model = BertForTokenClassification.from_pretrained("lanwuwei/GigaBERT-v3-Arabic-and-English")
More code examples can be found here.
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Languages
- en, ar, multilingual
- Created
- Mar 2, 2022
- Updated
- Jan 8, 2023