Downloads · 30 days
32
3% of all-time downloads
malaysia-ai/xlnet-large-bahasa-cased
xlnet-large-bahasa-cased is a feature extraction model from malaysia-ai. Use it when you need embeddings to search or compare text. It is set up for transformers.
Pretrained XLNET large language model for Malay.
Downloads · 30 days
32
3% of all-time downloads
All-time downloads
1.1K
Public
Repo size
2.4 GB
Likes
0
Public
Click a slice to open those files.
.bin1.2 GB · 100%
From the Hugging Face model README
Pretrained XLNET large language model for Malay.
xlnet-large-bahasa-cased model was pretrained on ~1.4 Billion words. Below is list of data we trained on,
You can use this model by installing torch or tensorflow and Huggingface library transformers. And you can use it directly by initializing it like this:
from transformers import XLNetModel, XLNetTokenizer
model = XLNetModel.from_pretrained('malay-huggingface/xlnet-large-bahasa-cased')
tokenizer = XLNetTokenizer.from_pretrained(
'malay-huggingface/xlnet-large-bahasa-cased',
do_lower_case = False,
)