Downloads · 30 days
882
2% of all-time downloads
mt5-small-german-query-generation
ml6team/mt5-small-german-query-generation
mt5-small-german-query-generation is a machine learning model from ml6team. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This model was created with the purpose to generate possible queries for a german input article.
All-time downloads
53.3K
Public
Repo size
3.6 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.pth1.2 GB · 50%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- mt5
- Access
- Public
- Created
- Apr 26, 2022
- Updated
- Apr 27, 2022
- SHA
- 5f95c71b
Try a prompt
Model card
From the Hugging Face model README
mt5-small-german-query-generation
Model description:
This model was created with the purpose to generate possible queries for a german input article.
For this model, we finetuned a multilingual T5 model mt5-small on the MMARCO dataset the machine translated version of the MS MARCO dataset.
The model was trained for 1 epoch, on 200,000 unique queries of the dataset. We trained the model on one K80 GPU for 25,000 iterations with following parameters:
- learning rate: 1e-3
- train batch size: 8
- max input sequence length: 512
- max target sequence length: 64
Model Performance:
Model evaluation was done on 2000 evaluation paragraphs of the dataset. Mean f1 ROUGE scores were calculated for the model.
| Rouge-1 | Rouge-2 | Rouge-L |
|---|---|---|
| 0.162 | 0.052 | 0.161 |
- Library
- transformers
- Type
- mt5
- License
- apache-2.0
- Languages
- de
- Created
- Apr 26, 2022
- Updated
- Apr 27, 2022