Downloads · 30 days
127
2% of all-time downloads
rbt4-h312
hfl/rbt4-h312
rbt4-h312 is a fill-mask model from hfl. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
In order to further promote the research and development of Chinese information processing, we launched a Chinese small pre-training model MiniRBT based on the self-developed knowledge distillation tool TextBrewer, co…
All-time downloads
5.7K
Public
Repo size
119 MB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.h572.9 MB · 61%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- apache-2.0
- Model type
- bert
- Access
- Public
- Created
- Nov 14, 2022
- Updated
- Nov 15, 2022
- SHA
- d68eec95
Try a prompt
Model card
From the Hugging Face model README
Please use 'Bert' related functions to load this model!
Chinese small pre-trained model MiniRBT
In order to further promote the research and development of Chinese information processing, we launched a Chinese small pre-training model MiniRBT based on the self-developed knowledge distillation tool TextBrewer, combined with Whole Word Masking technology and Knowledge Distillation technology.
This repository is developed based on：https://github.com/iflytek/MiniRBT
You may also interested in,
- Chinese LERT: https://github.com/ymcui/LERT
- Chinese PERT: https://github.com/ymcui/PERT
- Chinese MacBERT: https://github.com/ymcui/MacBERT
- Chinese ELECTRA: https://github.com/ymcui/Chinese-ELECTRA
- Chinese XLNet: https://github.com/ymcui/Chinese-XLNet
- Knowledge Distillation Toolkit - TextBrewer: https://github.com/airaria/TextBrewer
More resources by HFL: https://github.com/iflytek/HFL-Anthology
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- apache-2.0
- Languages
- zh
- Created
- Nov 14, 2022
- Updated
- Nov 15, 2022