Downloads · 30 days
13
14% of all-time downloads
xtremedistil-l6-h256-uncased-squad
SebOchs/xtremedistil-l6-h256-uncased-squad
xtremedistil-l6-h256-uncased-squad is a question answering model from SebOchs. Use it when the input is a question plus a passage. It is set up for transformers. The card lists the license as mit.
xtremedistil-l6-h256-uncased trained on SQuAD
All-time downloads
94
Public
Parameters
12.7M
102 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin50.8 MB · 50%
Parameter types
How the weights are stored.
F3212.7M · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
Test model for DL4NLP 2022 HW06
xtremedistil-l6-h256-uncased trained on SQuAD
Hyper parameters
- learning rate: 1e-5
- weight decay: 0.01
- warm up steps: 0
- learning rate scheduler: linear
- epochs: 1
Metric results on the dev set
- F1: 65.48
- EM: 51.67
- Task
- Question Answering
- Library
- transformers
- Type
- bert
- License
- mit
- Languages
- en
- Created
- Jul 24, 2022
- Updated
- Mar 11, 2025