Downloads · 30 days
7
3% of all-time downloads
lsg-roberta-base-4096
giant-oak/lsg-roberta-base-4096
lsg-roberta-base-4096 is a fill-mask model from giant-oak. Use it when you need the model to fill a missing word. It is set up for transformers.
Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here then MLM pretrained on a sample of the OSCAR and BookCorpus datasets: https://github.com/ccdv-ai/co…
All-time downloads
254
Public
Repo size
1.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin511 MB · 99%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Nov 30, 2023
- Updated
- Dec 27, 2023
- SHA
- 7b10738e
Try a prompt
Model card
From the Hugging Face model README
Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here then MLM pretrained on a sample of the OSCAR and BookCorpus datasets: https://github.com/ccdv-ai/convert_checkpoint_to_lsg
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- Created
- Nov 30, 2023
- Updated
- Dec 27, 2023