Downloads · 30 days
9
1% of all-time downloads
lsg-roberta-base-4096
OxxoCodes/lsg-roberta-base-4096
lsg-roberta-base-4096 is a fill-mask model from OxxoCodes. Use it when you need the model to fill a missing word. It is set up for transformers.
In its current state, this model has not yet been finetuned on long-context data. Do not use this model without performing additional pretraining, as performance will likely suffer.
All-time downloads
1.5K
Public
Repo size
1.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin511 MB · 99%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Jun 21, 2023
- Updated
- Jul 1, 2023
- SHA
- 9377ed36
Try a prompt
Model card
From the Hugging Face model README
In its current state, this model has not yet been finetuned on long-context data. Do not use this model without performing additional pretraining, as performance will likely suffer.
Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here: https://github.com/ccdv-ai/convert_checkpoint_to_lsg
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- Created
- Jun 21, 2023
- Updated
- Jul 1, 2023