Downloads · 30 days
41
10% of all-time downloads
distilbert-neuron
philschmid/distilbert-neuron
distilbert-neuron is a question answering model from philschmid. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tune checkpoint of DistilBERT-base-cased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1. This model reaches a F1 score of 87.1 on the dev set (for comparison, BERT bert-…
All-time downloads
396
Public
Repo size
319 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt160 MB · 99%
At a glance
- Task
- Question Answering
- Library
- transformers
- License
- apache-2.0
- Model type
- distilbert
- Access
- Public
- Created
- Mar 3, 2022
- Updated
- Mar 3, 2022
- SHA
- 63778b89
Try a prompt
Datasets
Model card
From the Hugging Face model README
AWS Neuron Conversion of distilbert-base-cased-distilled-squad
DistilBERT base cased distilled SQuAD
This model is a fine-tune checkpoint of DistilBERT-base-cased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1. This model reaches a F1 score of 87.1 on the dev set (for comparison, BERT bert-base-cased version reaches a F1 score of 88.7).
- Task
- Question Answering
- Library
- transformers
- Type
- distilbert
- License
- apache-2.0
- Languages
- en
- Created
- Mar 3, 2022
- Updated
- Mar 3, 2022