Downloads · 30 days
32
2% of all-time downloads
xlm-roberta-base-finetune-qa
airesearch/xlm-roberta-base-finetune-qa
xlm-roberta-base-finetune-qa is a question answering model from airesearch. Use it when the input is a question plus a passage. It is set up for transformers.
Finetuning xlm-roberta-base with the training set of iappwikiqasquad, thaiqasquad, and nscqa (removed examples which have cosine similarity with validation and test examples over 0.8; contexts of the latter two are tr…
All-time downloads
1.9K
Public
Repo size
5.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.1 GB · 99%
At a glance
- Task
- Question Answering
- Library
- transformers
- Model type
- xlm-roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jul 14, 2021
- SHA
- fb4f5550
Try a prompt
Model card
From the Hugging Face model README
xlm-roberta-base-finetune-qa
Finetuning xlm-roberta-base with the training set of iapp_wiki_qa_squad, thaiqa_squad, and nsc_qa (removed examples which have cosine similarity with validation and test examples over 0.8; contexts of the latter two are trimmed to be around 300 newmm words). Benchmarks shared on wandb using validation and test sets of iapp_wiki_qa_squad.
Trained with thai2transformers.
Train with:
export WANDB_PROJECT=wangchanberta-qa
export MODEL_NAME=xlm-roberta-base
python train_question_answering_lm_finetuning.py \
--model_name $MODEL_NAME \
--dataset_name chimera_qa \
--output_dir $MODEL_NAME-finetune-chimera_qa-model \
--log_dir $MODEL_NAME-finetune-chimera_qa-log \
--pad_on_right \
--fp16
- Task
- Question Answering
- Library
- transformers
- Type
- xlm-roberta
- Created
- Mar 2, 2022
- Updated
- Jul 14, 2021