Downloads · 30 days
35
6% of all-time downloads
GlyphBERT
HIT-TMG/GlyphBERT
GlyphBERT is a fill-mask model from HIT-TMG. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as afl-3.0.
This project page is about the pytorch code implementation of GlyphBERT by the HITsz-TMG research group.
All-time downloads
592
Public
Repo size
564 MB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.pt564 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- afl-3.0
- Model type
- bert
- Access
- Public
- Created
- Aug 24, 2022
- Updated
- Aug 30, 2022
- SHA
- 1d786d34
Try a prompt
Model card
From the Hugging Face model README
This project page is about the pytorch code implementation of GlyphBERT by the HITsz-TMG research group.
GlyphBERT is a Chinese pre-training model that includes Chinese character glyph features.It renders the input characters into images and designs them in the form of multi-channel location feature maps, and designs a two-layer residual convolutional neural network module to extract the image features of the characters for training.
The experimental results show that the performance of the pre-training model can be well improved by fusing the features of Chinese glyphs. GlyphBERT is much better than BERT in multiple downstream tasks, and has strong transferability.
For more details about using it, you can check the github repo
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- afl-3.0
- Languages
- zh
- Created
- Aug 24, 2022
- Updated
- Aug 30, 2022