Downloads · 30 days
0
Ekotame/bpe2m
bpe2m is a machine learning model from Ekotame. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
The purpose of this model is to help experiment BPE tokenization with a very large vocabulary. Applications include: text compression, language models, search engines. I recommend gigatoken to run this model: https://…
Downloads · 30 days
0
Access
Public
Updated Sep 4, 2026
Repo size
42.3 MB
Likes
1
Trending 1
Click a slice to open those files.
.model42.3 MB · 100%
From the Hugging Face model README
The purpose of this model is to help experiment BPE tokenization with a very large vocabulary. Applications include: text compression, language models, search engines. I recommend gigatoken to run this model: https://github.com/marcelroed/gigatoken .