Downloads · 30 days
23
1% of all-time downloads
bert-mini-sst2-distilled-sparse-90-1X4-block
Intel/bert-mini-sst2-distilled-sparse-90-1X4-block
bert-mini-sst2-distilled-sparse-90-1X4-block is a text classification model from Intel. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
Finetuned model pruned to 1:4 structured sparsity. The model is a pruned version of the BERT mini model.
All-time downloads
1.8K
Public
Repo size
195 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin79.8 MB · 69%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- mit
- Model type
- bert
- Access
- Public
- Created
- Aug 16, 2022
- Updated
- Nov 23, 2022
- SHA
- 9f940d7f
Try a prompt
Model card
From the Hugging Face model README
Sparse BERT mini model (uncased)
Finetuned model pruned to 1:4 structured sparsity. The model is a pruned version of the BERT mini model.
Intended Use
The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.
Evaluation Results
We get the following results on the sst2 tasks development set:
| Task | SST-2 (Acc) |
|---|---|
| 87.2 | |
| Better than dense bert mini which is 84.74%. |
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- License
- mit
- Created
- Aug 16, 2022
- Updated
- Nov 23, 2022