Downloads · 30 days
32
1% of all-time downloads
salti/arabic-t5-small-question-paraphrasing
arabic-t5-small-question-paraphrasing is a machine learning model from salti. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is a fine-tuned arabic-t5-small on the task of question paraphrasing.
Downloads · 30 days
32
1% of all-time downloads
All-time downloads
2.2K
Public
Parameters
110M
878 MB on disk
Likes
3
Public
Click a slice to open those files.
.bin439 MB · 50%
From the Hugging Face model README
This is a fine-tuned arabic-t5-small on the task of question paraphrasing.
A demo of the trained model using HF Spaces can be found here
The model was fine-tuned using the Semantic Question Similarity in Arabic data on kaggle.
Only the rows of the dataset where the label is True (the two questions have the same meaning) were taken.
The training data was then also mirrored; so if q1 and q2 were two questions with the same meaning, then (q1, q2) and (q2, q1) were both present in the training set. The evaluation set was kept unmirrored of course.
batch size | 128 |
dropout rate | 0.1 |
learning rate | 0.001 |
lr schedule | constant |
weight decay | 1e-7 |
epochs | 3 |
training loss | 0.7086 |
evaluation loss | 0.9819 |
meteor | 49.277 |
sacreBLEU-1 | 57.088 |
sacreBLEU-2 | 39.846 |
sacreBLEU-3 | 29.444 |
sacreBLEU-4 | 22.601 |
Rouge F1 max | 1.299 |