Downloads · 30 days
0
chhatramani/qwen3-nepali-legal-tokenizer
qwen3-nepali-legal-tokenizer is a machine learning model from chhatramani. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Custom high-efficiency Byte-Level BPE tokenizer designed from scratch for Small Language Models (SLMs) using the Qwen3 architecture template.
Downloads · 30 days
0
Access
Public
Updated Jun 19, 2026
Repo size
—
Likes
0
Public
Click a slice to open those files.
.json2.3 MB · 81%
From the Hugging Face model README
Custom high-efficiency Byte-Level BPE tokenizer designed from scratch for Small Language Models (SLMs) using the Qwen3 architecture template.
PreTrainedTokenizerFast packaging via complete individual files mapping framework splits (vocab.json, merges.txt, tokenizer.json).