Downloads · 30 days
7
2% of all-time downloads
vocabtrimmer/mt5-small-trimmed-en-squad-qg
mt5-small-trimmed-en-squad-qg is a text generation model from vocabtrimmer. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
This model is fine-tuned version of ckpts/mt5-small-trimmed-en for question generation task on the lmqg/qgsquad (datasetname: default) via lmqg.
Downloads · 30 days
7
2% of all-time downloads
All-time downloads
305
Public
Repo size
2.1 GB
Likes
0
Public
Click a slice to open those files.
.bin1 GB · 98%
From the Hugging Face model README
vocabtrimmer/mt5-small-trimmed-en-squad-qgThis model is fine-tuned version of ckpts/mt5-small-trimmed-en for question generation task on the lmqg/qg_squad (dataset_name: default) via lmqg.
lmqgfrom lmqg import TransformersQG
# initialize model
model = TransformersQG(language="en", model="vocabtrimmer/mt5-small-trimmed-en-squad-qg")
# model prediction
questions = model.generate_q(list_context="William Turner was an English painter who specialised in watercolour landscapes", list_answer="William Turner")
transformersfrom transformers import pipeline
pipe = pipeline("text2text-generation", "vocabtrimmer/mt5-small-trimmed-en-squad-qg")
output = pipe("<hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.")
| Score | Type | Dataset | |
|---|---|---|---|
| BERTScore | 90.14 | default | lmqg/qg_squad |
| Bleu_1 | 54.29 | default | lmqg/qg_squad |
| Bleu_2 | 38 | default | lmqg/qg_squad |
| Bleu_3 | 28.59 | default | lmqg/qg_squad |
| Bleu_4 | 22.1 | default | lmqg/qg_squad |
| METEOR | 24.03 | default | lmqg/qg_squad |
| MoverScore | 62.96 | default | lmqg/qg_squad |
| ROUGE_L | 49.52 | default | lmqg/qg_squad |
The following hyperparameters were used during fine-tuning:
The full configuration can be found at fine-tuning config file.
@inproceedings{ushio-etal-2022-generative,
title = "{G}enerative {L}anguage {M}odels for {P}aragraph-{L}evel {Q}uestion {G}eneration",
author = "Ushio, Asahi and
Alva-Manchego, Fernando and
Camacho-Collados, Jose",
booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
month = dec,
year = "2022",
address = "Abu Dhabi, U.A.E.",
publisher = "Association for Computational Linguistics",
}