Downloads · 30 days
8
3% of all-time downloads
vocabtrimmer/mt5-small-trimmed-en-5000-squad-qg
mt5-small-trimmed-en-5000-squad-qg is a text generation model from vocabtrimmer. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
This model is fine-tuned version of ckpts/mt5-small-trimmed-en-5000 for question generation task on the lmqg/qgsquad (datasetname: default) via lmqg.
Downloads · 30 days
8
3% of all-time downloads
All-time downloads
309
Public
Repo size
398 MB
Likes
0
Public
Click a slice to open those files.
.bin197 MB · 97%
From the Hugging Face model README
vocabtrimmer/mt5-small-trimmed-en-5000-squad-qgThis model is fine-tuned version of ckpts/mt5-small-trimmed-en-5000 for question generation task on the lmqg/qg_squad (dataset_name: default) via lmqg.
lmqgfrom lmqg import TransformersQG
# initialize model
model = TransformersQG(language="en", model="vocabtrimmer/mt5-small-trimmed-en-5000-squad-qg")
# model prediction
questions = model.generate_q(list_context="William Turner was an English painter who specialised in watercolour landscapes", list_answer="William Turner")
transformersfrom transformers import pipeline
pipe = pipeline("text2text-generation", "vocabtrimmer/mt5-small-trimmed-en-5000-squad-qg")
output = pipe("<hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.")
| Score | Type | Dataset | |
|---|---|---|---|
| BERTScore | 90.01 | default | lmqg/qg_squad |
| Bleu_1 | 55.13 | default | lmqg/qg_squad |
| Bleu_2 | 38.84 | default | lmqg/qg_squad |
| Bleu_3 | 29.4 | default | lmqg/qg_squad |
| Bleu_4 | 22.84 | default | lmqg/qg_squad |
| METEOR | 24.75 | default | lmqg/qg_squad |
| MoverScore | 63.43 | default | lmqg/qg_squad |
| ROUGE_L | 50.34 | default | lmqg/qg_squad |
The following hyperparameters were used during fine-tuning:
The full configuration can be found at fine-tuning config file.
@inproceedings{ushio-etal-2022-generative,
title = "{G}enerative {L}anguage {M}odels for {P}aragraph-{L}evel {Q}uestion {G}eneration",
author = "Ushio, Asahi and
Alva-Manchego, Fernando and
Camacho-Collados, Jose",
booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing",
month = dec,
year = "2022",
address = "Abu Dhabi, U.A.E.",
publisher = "Association for Computational Linguistics",
}