Downloads · 30 days
15
0% of all-time downloads
latte-mc-bert-base-thai-ws
yacht/latte-mc-bert-base-thai-ws
latte-mc-bert-base-thai-ws is a token classification model from yacht. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
This is a variant of the pre-trained model BERT model. The model was pre-trained on texts in the Thai language and fine-tuned for word segmentation based on bert-base-multilingual-cased. This version of the model proc…
All-time downloads
4.4K
Public
Repo size
2.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 96%
At a glance
- Task
- Token Classification
- Library
- transformers
- License
- cc-by-sa-4.0
- Model type
- bert
- Access
- Public
- Created
- Sep 5, 2023
- Updated
- Sep 10, 2023
- SHA
- 5be93b00
Model card
From the Hugging Face model README
Multi-criteria BERT base Thai with Lattice for Word Segmentation
This is a variant of the pre-trained model BERT model. The model was pre-trained on texts in the Thai language and fine-tuned for word segmentation based on bert-base-multilingual-cased. This version of the model processes input texts with character-level with word-level incorporated with a lattice structure.
The scripts for the pre-training are available at tchayintr/latte-ptm-ws.
The LATTE scripts are available at tchayintr/latte-ws.
Model architecture
The model architecture is described in this paper.
Training Data
The model is trained on multiple Thai word segmented datasets, including best2010, lst20, tlc (tnhc), vistec-tp-th-2021 (vistec2021) and wisesight_sentiment (ws160). The datasets can be accessed as follows:
Licenses
The pre-trained model is distributed under the terms of the Creative Commons Attribution-ShareAlike 4.0.
Acknowledgments
This model was trained with GPU servers provided by Okumura-Funakoshi NLP Group.
- Task
- Token Classification
- Library
- transformers
- Type
- bert
- License
- cc-by-sa-4.0
- Languages
- th
- Created
- Sep 5, 2023
- Updated
- Sep 10, 2023