Downloads · 30 days
16
1% of all-time downloads
distilbert-viet-diacritic-restoration
saeliddp/distilbert-viet-diacritic-restoration
distilbert-viet-diacritic-restoration is a token classification model from saeliddp. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This model is a finetuned version of the DistilBERT base multilingual model modified for token classification where the tokens are ASCII characters and the labels are Vietnamese characters. The code for building and t…
All-time downloads
1.4K
Public
Repo size
344 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin172 MB · 100%
At a glance
- Task
- Token Classification
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- distilbert
- Access
- Public
- Created
- Dec 14, 2022
- Updated
- Dec 14, 2022
- SHA
- 76fec92d
Try a prompt
Model card
From the Hugging Face model README
Model Description
This model is a finetuned version of the DistilBERT base multilingual model modified for token classification where the tokens are ASCII characters and the labels are Vietnamese characters. The code for building and training this model can be found here.
The model is trained on the Vietnamese wikipedia data here.
We encourage potential users of this model to check out the BERT base multilingual model card to learn more about usage, limitations and potential biases.
- Developed by: Daniel Saelid, Sachin Kumar, Yulia Tsvetkov
- Model type: Transformer-based language model
- Related Models: DistilBERT base multilingual model, BERT base multilingual model
- Resources for more information:
Direct Use
You can use the raw model to restore diacritics for ASCII-ified Vietnamese text.
Evaluation
The model developers report the following accuracies for restoring diacritics on ASCII-ified Vietnamese text. All metrics only consider syllables that contain just alphabetic characters.
| Character Accuracy | Syllable Accuracy | Sentence Accuracy | | 98.75 | 96.10 | 50.26 |
- Task
- Token Classification
- Library
- transformers
- Type
- distilbert
- License
- cc-by-nc-4.0
- Created
- Dec 14, 2022
- Updated
- Dec 14, 2022