Downloads · 30 days
10
4% of all-time downloads
wiki_contrastive_pretrain
yyu/wiki_contrastive_pretrain
wiki_contrastive_pretrain is a fill-mask model from yyu. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
The BERT model pretrained on the news corpus (https://huggingface.co/datasets/yyu/wikicorpus). Used in the paper ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval.
All-time downloads
280
Public
Repo size
933 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin438 MB · 88%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Sep 8, 2023
- Updated
- Sep 13, 2023
- SHA
- cccb0f54
Try a prompt
Model card
From the Hugging Face model README
The BERT model pretrained on the news corpus (https://huggingface.co/datasets/yyu/wiki_corpus). Used in the paper ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval.
See github: https://github.com/yueyu1030/ReGen and paper: https://arxiv.org/abs/2305.10703 for details.
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- en
- Created
- Sep 8, 2023
- Updated
- Sep 13, 2023