Downloads · 30 days
0
flexitok/parity-aware-bpe-ratio
parity-aware-bpe-ratio is a machine learning model from flexitok. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Parity-aware-bpe trained with the following ratios:
Downloads · 30 days
0
Access
Public
Updated Aug 9, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
.json10.5 MB · 100%
From the Hugging Face model README
Parity-aware-bpe trained with the following ratios:
| Language | FLORES-200 | Ratio |
|---|---|---|
| Arabic | arb_Arab | 1.6 |
| Czech | ces_Latn | 1.09 |
| Chinese | cmn_Hani | 0.94 |
| Danish | dan_Latn | 1.05 |
| German | deu_Latn | 1.19 |
| Greek | ell_Grek | 2.18 |
| English | eng_Latn | 1 |
| Farsi | fas_Arab | 1.09 |
| French | fra_Latn | 1.23 |
| Hungarian | hun_Latn | 1.16 |
| Indonesian | ind_Latn | 1.09 |
| Italian | ita_Latn | 1.18 |
| Japanese | jpn_Jpan | 1.28 |
| Dutch | nld_Latn | 1.11 |
| Polish | pol_Latn | 1.13 |
| Portuguese | por_Latn | 1.12 |
| Russian | rus_Cyrl | 2.01 |
| Spanish | spa_Latn | 1.21 |
| Swedish | swe_Latn | 1.05 |
| Turkish | tur_Latn | 1.12 |
| Vietnamese | vie_Latn | 1.4 |