Downloads · 30 days
0
km-bpe-md-v3
Msok99/km-bpe-md-v3
km-bpe-md-v3 is a machine learning model from Msok99. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A Khmer + English + Math-aware tokenizer trained using the Hugging Face tokenizers library. - Type: BPE (Morphology-driven) - Vocab size: 16,100 - Includes math, Latin, Khmer, and symbol tokens.
Access
Public
Updated Oct 9, 2025
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json3 MB · 100%
At a glance
- Access
- Public
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025
- SHA
- 220bceb4
Model card
From the Hugging Face model README
Khmer BPE-MD v3 Tokenizer
A Khmer + English + Math-aware tokenizer trained using the Hugging Face tokenizers library.
- Type: BPE (Morphology-driven)
- Vocab size: 16,100
- Includes math, Latin, Khmer, and symbol tokens.
- Created
- Oct 9, 2025
- Updated
- Oct 9, 2025