Downloads · 30 days
13
3% of all-time downloads
bert-base-squadv1-pruneofa-90pc-bt
vuiseng9/bert-base-squadv1-pruneofa-90pc-bt
bert-base-squadv1-pruneofa-90pc-bt is a question answering model from vuiseng9. Use it when the input is a question plus a passage. It is set up for transformers.
This model is transfer-learning of bert-base pruneofa 90% sparse on Squadv1 dataset.
All-time downloads
472
Public
Repo size
4.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin3.3 GB · 70%
At a glance
- Task
- Question Answering
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jan 18, 2022
- SHA
- b3285931
Try a prompt
Model card
From the Hugging Face model README
This model is transfer-learning of bert-base pruneofa 90% sparse on Squadv1 dataset.
eval_exact_match = 80.2933
eval_f1 = 87.6788
eval_samples = 10784
Train
use https://github.com/IntelLabs/Model-Compression-Research-Package.git
see pruneofa-transfer-learning.sh
Eval
export CUDA_VISIBLE_DEVICES=0
OUTDIR=eval-bert-base-squadv1-pruneofa-90pc-bt
WORKDIR=transformers/examples/pytorch/question-answering
cd $WORKDIR
nohup python run_qa.py \
--model_name_or_path vuiseng9/bert-base-squadv1-pruneofa-90pc-bt \
--dataset_name squad \
--do_eval \
--per_device_eval_batch_size 128 \
--max_seq_length 384 \
--doc_stride 128 \
--overwrite_output_dir \
--output_dir $OUTDIR 2>&1 | tee $OUTDIR/run.log &
- Task
- Question Answering
- Library
- transformers
- Type
- bert
- Created
- Mar 2, 2022
- Updated
- Jan 18, 2022