Downloads · 30 days
12
18% of all-time downloads
plantbert-vanilla-cased
shius/plantbert-vanilla-cased
plantbert-vanilla-cased is a fill-mask model from shius. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
All-time downloads
67
Public
Repo size
876 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin438 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Nov 29, 2023
- Updated
- Nov 29, 2023
- SHA
- 737453bb
Try a prompt
Datasets
Model card
From the Hugging Face model README
Code availability
Relevant settings
- env:
- rand_seed : 20231002
- test_size : 0.1
- bert_config:
- vocab_size : 30_522
- max_length : 512
- training_arguments:
- resume_from_ckpt : False
- mlm : True
- mlm_prob : 0.2
- eval_strategy : 'steps'
- overwrite_out : True
- num_epochs : 30
- train_batch_size : 20
- grad_acc_steps : 8
- eval_batch_size : 64
- logging_strategy : 'steps'
- log_steps : 500
- save_strategy : 'steps'
- save_steps : 500
- safetensors : True
- load_best_at_end : True
- save_total_limit : 5
Model evaluation (loss)
- Training: 1.8376
- Validation: 1.7476
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- en
- Created
- Nov 29, 2023
- Updated
- Nov 29, 2023