Downloads · 30 days
0
zerpal-mbert-tokenizer
udmurtNLP/zerpal-mbert-tokenizer
zerpal-mbert-tokenizer is a machine learning model from udmurtNLP. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
You can use this model directly with a pipeline for masked language modeling:
Access
Public
Updated Jun 8, 2024
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json7.4 MB · 88%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Mar 12, 2024
- Updated
- Jun 8, 2024
- SHA
- d36ed2c4
Model card
From the Hugging Face model README
Zerpal-mBERT-tokenizer
How to use
You can use this model directly with a pipeline for masked language modeling:
from transformers import pipeline
unmasker = pipeline('fill-mask', model='udmurtNLP/zerpal-mbert', tokenizer='udmurtNLP/zerpal-mbert-tokenizer')
unmasker("Ӟечбур! Мынам нимы [MASK].")
Here is how to use this model to get the features of a given text in PyTorch:
from transformers import BertTokenizer, BertModel
tokenizer = BertTokenizer.from_pretrained('udmurtNLP/zerpal-mbert-tokenizer')
model = BertModel.from_pretrained("udmurtNLP/zerpal-mbert")
text = "Яратон, яратон, мар меда сыӵе тон?"
encoded_input = tokenizer(text, return_tensors='pt')
output = model(**encoded_input)
- Library
- transformers
- Languages
- udm
- Created
- Mar 12, 2024
- Updated
- Jun 8, 2024