Downloads · 30 days
0
bn-kenlm-5gram-tokenized
pawmeow/bn-kenlm-5gram-tokenized
bn-kenlm-5gram-tokenized is a machine learning model from pawmeow. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository hosts a Bengali 5-gram KenLM language model built from: - Kaggle newspaper corpus (Bangla sentences) - Mozilla Common Voice Bengali transcripts
Access
Public
Updated Nov 14, 2025
Repo size
1.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.arpa648 MB · 57%
At a glance
- Access
- Public
- Created
- Nov 14, 2025
- Updated
- Nov 14, 2025
- SHA
- cf657606
Model card
From the Hugging Face model README
Bangla KenLM 5-gram tokenized
This repository hosts a Bengali 5-gram KenLM language model built from:
- Kaggle newspaper corpus (Bangla sentences)
- Mozilla Common Voice Bengali transcripts
Usage:
- Binary LM path:
bangla_5gram_tokenized.binary - ARPA LM path:
bangla_5gram_tokenized.arpa
Intended for CTC beam search rescoring in ASR systems (e.g., Wav2Vec2-CTC + pyctcdecode).
Licensing:
- Ensure your downstream use complies with the source corpora licenses.
- Created
- Nov 14, 2025
- Updated
- Nov 14, 2025