Downloads · 30 days
44
2% of all-time downloads
bert-base-uncased-mnli-sparse-70-unstructured-no-classifier
Intel/bert-base-uncased-mnli-sparse-70-unstructured-no-classifier
bert-base-uncased-mnli-sparse-70-unstructured-no-classifier is a fill-mask model from Intel. Use it when you need the model to fill a missing word. It is set up for transformers.
Fine tuned sparse BERT base to MNLI (GLUE Benchmark) task from bert-base-uncased-sparse-70-unstructured. <br This model doesn't have a classifier layer to enable easier loading of the model for training to other downs…
All-time downloads
2.5K
Public
Repo size
876 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin438 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jun 29, 2021
- SHA
- 4426b158
Try a prompt
Model card
From the Hugging Face model README
Sparse BERT base model fine tuned to MNLI without classifier layer (uncased)
Fine tuned sparse BERT base to MNLI (GLUE Benchmark) task from bert-base-uncased-sparse-70-unstructured.
<br>
This model doesn't have a classifier layer to enable easier loading of the model for training to other downstream tasks.
In all the other layers this model is similar to bert-base-uncased-mnli-sparse-70-unstructured.
<br><br>
Note: This model requires transformers==2.10.0
Evaluation Results
Matched: 82.5%
Mismatched: 83.3%
This model can be further fine-tuned to other tasks and achieve the following evaluation results:
| Task | QQP (Acc/F1) | QNLI (Acc) | SST-2 (Acc) | STS-B (Pears/Spear) | SQuADv1.1 (Acc/F1) |
|---|---|---|---|---|---|
| 90.2/86.7 | 90.3 | 91.5 | 88.9/88.6 | 80.5/88.2 |
- Task
- Fill-Mask
- Library
- transformers
- Type
- bert
- Languages
- en
- Created
- Mar 2, 2022
- Updated
- Jun 29, 2021