Downloads · 30 days
0
harmony-latin-plus
spyysalo/harmony-latin-plus
harmony-latin-plus is a machine learning model from spyysalo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Version of the gpt-oss tokenizer (o200kharmony) filtered to exclude tokens with characters that are not in the Latin, Cyrillic, Greek, or Georgian scripts (or unicode Common/Unknown) using https://github.com/spyysalo/…
Access
Public
Updated Oct 13, 2025
Repo size
23.3 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json23.3 MB · 100%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025
- SHA
- 3d127b57
Model card
From the Hugging Face model README
Version of the gpt-oss tokenizer (o200k_harmony) filtered to exclude tokens with characters that are not in the Latin, Cyrillic, Greek, or Georgian scripts (or unicode Common/Unknown) using https://github.com/spyysalo/tokenizer-filter/ as follows:
python3 filter_by_script.py openai/gpt-oss-120b Latin Cyrillic Greek Georgian --save-dir harmony-latin-plus
- Library
- transformers
- Created
- Oct 13, 2025
- Updated
- Oct 13, 2025