Downloads · 30 days
8
1% of all-time downloads
latte-mc-bert-base-chinese-ws
yacht/latte-mc-bert-base-chinese-ws
latte-mc-bert-base-chinese-ws is a token classification model from yacht. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as cc-by-sa-4.0.
This is a variant of the pre-trained model BERT model. The model was pre-trained on texts in the Chinese language and fine-tuned for word segmentation based on bert-base-chinese. This version of the model processes in…
All-time downloads
722
Public
Repo size
2.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 95%
At a glance
- Task
- Token Classification
- Library
- transformers
- License
- cc-by-sa-4.0
- Model type
- bert
- Access
- Public
- Created
- Aug 31, 2023
- Updated
- Sep 10, 2023
- SHA
- 7ce48ee1
Try a prompt
Model card
From the Hugging Face model README
Multi-criteria BERT base Chinese with Lattice for Word Segmentation
This is a variant of the pre-trained model BERT model. The model was pre-trained on texts in the Chinese language and fine-tuned for word segmentation based on bert-base-chinese. This version of the model processes input texts with character-level with word-level incorporated with a lattice structure.
The scripts for the pre-training are available at tchayintr/latte-ptm-ws.
The LATTE scripts are available at tchayintr/latte-ws.
Model architecture
The model architecture is described in this paper.
Training Data
The model is trained on multiple Chinese word segmented datasets, including ctb6, sighan2005 (as, cityu, msra, pku), sighan2008 (sxu), and cnc. The datasets can be accessed from here.
Licenses
The pre-trained model is distributed under the terms of the Creative Commons Attribution-ShareAlike 4.0.
Acknowledgments
This model was trained with GPU servers provided by Okumura-Funakoshi NLP Group.
- Task
- Token Classification
- Library
- transformers
- Type
- bert
- License
- cc-by-sa-4.0
- Languages
- zh
- Created
- Aug 31, 2023
- Updated
- Sep 10, 2023