Downloads · 30 days
569
33% of all-time downloads
bert-tiny-finetuned-legal-contracts-longer
muhtasham/bert-tiny-finetuned-legal-contracts-longer
bert-tiny-finetuned-legal-contracts-longer is a fill-mask model from muhtasham. Use it when you need the model to fill a missing word. It is set up for transformers.
This model is a fine-tuned version of google/bertuncasedL-2H-128A-2 on the portion of legalcontracts dataset but for longer epochs.
All-time downloads
1.7K
Public
Parameters
4.4M
4.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin17.7 MB · 50%
Parameter types
How the weights are stored.
F324.4M · 100%
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
bert-tiny-finetuned-legal-contracts-longer
This model is a fine-tuned version of google/bert_uncased_L-2_H-128_A-2 on the portion of legal_contracts dataset but for longer epochs.
Note
The model was not trained on the whole dataset which is around 9.5 GB, but only
The first 10% of train + the last 10% of train.
datasets_train = load_dataset('albertvillanova/legal_contracts' , split='train[:10%]')
datasets_validation = load_dataset('albertvillanova/legal_contracts' , split='train[-10%:]')
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- Created
- Aug 3, 2022
- Updated
- Sep 13, 2023