Downloads · 30 days
0
kenlm-uk
Yehor/kenlm-uk
kenlm-uk is a text generation model from Yehor. Use it when you need the model to write or continue text. The card lists the license as cc-by-nc-sa-4.0.
- Discord: https://bit.ly/discord-uds - Speech Recognition: https://t.me/speechrecognitionuk - Speech Synthesis: https://t.me/speechsynthesisuk - Natural Language Processing: https://t.me/nlpuk
Access
Public
Updated Mar 31, 2025
Repo size
12.1 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.binary10.8 GB · 99%
At a glance
- Task
- Text Generation
- License
- cc-by-nc-sa-4.0
- Access
- Public
- Created
- Sep 11, 2022
- Updated
- Mar 31, 2025
- SHA
- defda5a4
Model card
From the Hugging Face model README
Community
- Discord: https://bit.ly/discord-uds
- Speech Recognition: https://t.me/speech_recognition_uk
- Speech Synthesis: https://t.me/speech_synthesis_uk
- Natural Language Processing: https://t.me/nlp_uk
Overview
Different KenLM models for Ukrainian.
Metrics
Tested with an acoustic model from w2v-xls-r-uk model:
| Model | CER | WER |
|---|---|---|
| no LM | 0.0412 | 0.2206 |
| lm-3gram-10k (alpha=0.1) | 0.0398 | 0.2191 |
| lm-4gram-10k (alpha=0.1) | 0.0398 | 0.219 |
| lm-5gram-10k (alpha=0.1) | 0.0398 | 0.219 |
| lm-3gram-30k | 0.038 | 0.2023 |
| lm-4gram-30k | 0.0379 | 0.2018 |
| lm-5gram-30k | 0.0379 | 0.202 |
| lm-3gram-50k | 0.0348 | 0.1826 |
| lm-4gram-50k | 0.0347 | 0.1818 |
| lm-5gram-50k | 0.0347 | 0.1821 |
| lm-3gram-100k | 0.031 | 0.1588 |
| lm-4gram-100k | 0.0308 | 0.1579 |
| lm-5gram-100k | 0.0308 | 0.1579 |
| lm-3gram-300k | 0.0261 | 0.1294 |
| lm-4gram-300k | 0.0261 | 0.1293 |
| lm-5gram-300k | 0.0261 | 0.1293 |
| lm-3gram-500k | 0.0248 | 0.1209 |
| lm-4gram-500k | 0.0247 | 0.1207 |
| lm-5gram-500k | 0.0247 | 0.1209 |
Files of the KenLM models are under the Files and versions section.
Attribution
- Chaplynskyi, D. et al. (2021) lang-uk Ukrainian Ubercorpus [Data set]. https://lang.org.ua/uk/corpora/#anchor4
Cite this work
@misc {smoliakov_2025,
author = { {Smoliakov} },
title = { kenlm-uk (Revision a85db43) },
year = 2025,
url = { https://huggingface.co/Yehor/kenlm-uk },
doi = { 10.57967/hf/4555 },
publisher = { Hugging Face }
}
- Task
- Text Generation
- License
- cc-by-nc-sa-4.0
- Languages
- uk
- Created
- Sep 11, 2022
- Updated
- Mar 31, 2025