Downloads · 30 days
19
0% of all-time downloads
Intel/bert-large-uncased-squadv1.1-sparse-80-1x4-block-pruneofa
bert-large-uncased-squadv1.1-sparse-80-1x4-block-pruneofa is a question answering model from Intel. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as apache-2.0.
This model is a result of fine-tuning a Prune OFA 80% 1x4 block sparse pre-trained BERT-Large combined with knowledge distillation. This model yields the following results on SQuADv1.1 development set:<br {"exactmatch…
Downloads · 30 days
19
0% of all-time downloads
All-time downloads
6.1K
Public
Repo size
4 GB
Likes
1
Public
Click a slice to open those files.
.bin1.3 GB · 50%
From the Hugging Face model README
This model is a result of fine-tuning a Prune OFA 80% 1x4 block sparse pre-trained BERT-Large combined with knowledge distillation.
This model yields the following results on SQuADv1.1 development set:<br>
{"exact_match": 84.673, "f1": 91.174}
For further details see our paper, Prune Once for All: Sparse Pre-Trained Language Models, and our open source implementation available here.