Downloads · 30 days
0
argostranslate_en_eu_1_9
itzune/argostranslate_en_eu_1_9
argostranslate_en_eu_1_9 is a machine learning model from itzune. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This model was trained using argostrain training scripts with 11,542,706 English to Basque parallel strings extracted from datasets obtained directly from the Opus project.
Access
Public
Updated Nov 11, 2024
Repo size
75.8 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.argosmodel75.8 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Nov 11, 2024
- Updated
- Nov 11, 2024
- SHA
- 78f0d8ed
Model card
From the Hugging Face model README
Itzune v1.9 EN -> EU machine translation argos model
This model was trained using argostrain training scripts with 11,542,706 English to Basque parallel strings extracted from datasets obtained directly from the Opus project.
Model description
- Developed by: argostranslate
- Model type: traslation
- Model version: v1.9
- Source Language: English
- Target Language: Basque
- License: MIT
Training Data
The English-Basque parallel sentences were collected from the following datasets:
| Dataset | Sentences before cleaning |
|---|---|
| CCMatrix v1 | 7,788,871 |
| OpenSubtitles v2018 | 805,780 |
| XLEnt v1.2 | 800,631 |
| GNOME v1 | 652,298 |
| HPLT v1.1 | 610,694 |
| EhuHac v1 | 585,210 |
| WikiMatrix v1 | 119,480 |
| KDE4 v2 | 100,160 |
| wikimedia v20230407 | 60,990 |
| bible-uedin v1 | 15,893 |
| Tatoeba v2023-04-12 | 2,070 |
| Wiktionary | 629 |
| Total | 11,542,706 |
Evaluation results
Below are the evaluation results on the machine translation from English to Basque compared to Google Translate, NLLB 200 3.3B and mt-hitz-en-eu:
BLEU scores
| Test set | Google Translate | NLLB 3.3 | mt-hitz-en-eu | itzune 1.9 |
|---|---|---|---|---|
| Flores 200 devtest | 20.5 | 13.3 | 19.2 | 17.0 |
| TaCON | 12.1 | 9.4 | 8.8 | - |
| NTREX | 15.7 | 8.0 | 14.5 | - |
| Average | 16.1 | 10.2 | 14.2 | - |
TER scores
| Test set | Google Translate | NLLB 3.3 | mt-hitz-en-eu | itzune 1.9 |
|---|---|---|---|---|
| Flores 200 devtest | 59.5 | 70.4 | 65.0 | 70.1 |
| TaCON | 69.5 | 75.3 | 76.8 | - |
| NTREX | 65.8 | 81.6 | 66.7 | - |
| Average | 64.9 | 75.8 | 68.2 | - |
- License
- mit
- Languages
- en, eu
- Created
- Nov 11, 2024
- Updated
- Nov 11, 2024