Downloads · 30 days
7
2% of all-time downloads
QnA_distilBERT_capstone
sharanya02/QnA_distilBERT_capstone
QnA_distilBERT_capstone is a question answering model from sharanya02. Use it when the input is a question plus a passage. It is set up for transformers.
This model is a fine-tuned version of distilbert-base-cased on SQuAD dataset. It achieves the following results on the evaluation set:
All-time downloads
389
Public
Repo size
261 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.h5261 MB · 100%
At a glance
- Task
- Question Answering
- Library
- transformers
- Model type
- distilbert
- Access
- Public
- Created
- Jan 11, 2023
- Updated
- Mar 14, 2023
- SHA
- 6a4a5248
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
This model is a fine-tuned version of distilbert-base-cased on SQuAD dataset. It achieves the following results on the evaluation set:
- Train Loss: 0.9125
- Validation Loss: 1.0106
- Epoch: 2
- Training Accuracy: 0.7709
- Validation Accuracy: 0.7613
After using regularization and finetuning our model, here’s how it is performing:
- Train Loss: 0.7615
- Validation Loss: 0.6138
- Epoch: 4
- Training Accuracy: 0.8102
- Validation Accuracy: 0.8210
- Task
- Question Answering
- Library
- transformers
- Type
- distilbert
- Created
- Jan 11, 2023
- Updated
- Mar 14, 2023