Downloads · 30 days
7
4% of all-time downloads
translate-oci-cat
softcatala/translate-oci-cat
translate-oci-cat is a translation model from softcatala. Use it when you need text moved from one language to another. It is set up for opennmt. The card lists the license as mit.
Occitan (Languedocian variant) - Catalan translation model based on OpenNMT. These are the same models that we have in production at https://www.softcatala.org/traductor/.
All-time downloads
186
Public
Repo size
71.9 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin70.7 MB · 98%
At a glance
- Task
- Translation
- Library
- opennmt
- License
- mit
- Access
- Public
- Created
- Aug 20, 2024
- Updated
- Aug 20, 2024
- SHA
- e567847d
Model card
From the Hugging Face model README
Introduction
Occitan (Languedocian variant) - Catalan translation model based on OpenNMT. These are the same models that we have in production at https://www.softcatala.org/traductor/.
Usage
pip3 install ctranslate2 pyonmttok
Simple translation using Python:
import ctranslate2
import pyonmttok
from huggingface_hub import snapshot_download
model_dir = snapshot_download(repo_id="softcatala/translate-oci-cat", revision="main")
tokenizer=pyonmttok.Tokenizer(mode="none", sp_model_path = model_dir + "/sp_m.model")
tokenized=tokenizer.tokenize("Hola amics")
import ctranslate2
translator = ctranslate2.Translator(model_dir)
translated = translator.translate_batch([tokenized[0]])
print(tokenizer.detokenize(translated[0][0]['tokens']))
Hola món!
Benchmarks
| testset | BLEU |
|---|---|
| test dataset (from train/dev/test) | 74.9 |
| Flores200 dataset | 32.5 |
Additional information
- Task
- Translation
- Library
- opennmt
- License
- mit
- Languages
- ca, oc
- Created
- Aug 20, 2024
- Updated
- Aug 20, 2024