Downloads · 30 days
16
2% of all-time downloads
agriculture-bert-base-chinese
gigilin7/agriculture-bert-base-chinese
agriculture-bert-base-chinese is a fill-mask model from gigilin7. Use it when you need the model to fill a missing word. It is set up for transformers.
This is a bert model for agriculture domain. The self-supervised learning approach of MLM was used to train the model. - Masked language modeling (MLM): taking a sentence, the model randomly masks 15% of the words in…
All-time downloads
790
Public
Repo size
818 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin409 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Jun 29, 2023
- Updated
- Jun 29, 2023
- SHA
- 7941c158
Try a prompt
Model card
From the Hugging Face model README
agriculture-bert-base-chinese
This is a bert model for agriculture domain. The self-supervised learning approach of MLM was used to train the model.
- Masked language modeling (MLM): taking a sentence, the model randomly masks 15% of the words in the input then run the entire masked sentence through the model and has to predict the masked words.
- This is different from traditional recurrent neural networks (RNNs) that usually see the words one after the other, or from autoregressive models like GPT internally masks the future tokens.
- It allows the model to learn a bidirectional representation of the sentence.
from transformers import pipeline
fill_mask = pipeline(
"fill-mask",
model="gigilin7/agriculture-bert-base-chinese",
tokenizer="gigilin7/agriculture-bert-base-chinese"
)
res = fill_mask("[MASK]是許多亞洲國家的主要糧食作物。")
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- Languages
- zh
- Created
- Jun 29, 2023
- Updated
- Jun 29, 2023