Skip to content

Sai5480

tokenizer-iso-cluster-8-vocab-128000

Sai5480/tokenizer-iso-cluster-8-vocab-128000

tokenizer-iso-cluster-8-vocab-128000 is a machine learning model from Sai5480. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This is a multilingual tokenizer trained on cluster 8 with vocabulary size 128000.

Downloads · 30 days

64

33% of all-time downloads

All-time downloads

193

Public

Repo size

2.2 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.model2.2 MB · 52%

At a glance

License
mit
Model type
sentencepiece
Access
Public
Created
Sep 16, 2025
Updated
Sep 16, 2025
SHA
d080f0a2
Type
sentencepiece
License
mit
Created
Sep 16, 2025
Updated
Sep 16, 2025