Downloads · 30 days
0
gptoss-20b-myanmar-tokenizer-v2
kkomyoeminaung/gptoss-20b-myanmar-tokenizer-v2
gptoss-20b-myanmar-tokenizer-v2 is a machine learning model from kkomyoeminaung. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
⚠️ ဒါဟာ GPT-OSS-20B (Harmony/tiktoken tokenizer) အတွက်သာ ဖြစ်ပါသည်
Access
Public
Updated Jul 10, 2026
Repo size
28.1 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json28.1 MB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026
- SHA
- eb62666b
Model card
From the Hugging Face model README
GPT-OSS-20B Myanmar Tokenizer V2
| Value | |
|---|---|
| Base tokenizer len (GPT-OSS) | 200,019 |
| Myanmar new tokens | 1,428 |
| Final vocab | 201,447 |
| model.config.vocab_size (base, reserved slots incl.) | 201,088 |
| tokenizer_class | TokenizersBackend |
⚠️ ဒါဟာ GPT-OSS-20B (Harmony/tiktoken tokenizer) အတွက်သာ ဖြစ်ပါသည်
- License
- other
- Languages
- my
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026