the-sweater-cat

v2-tokenizer

the-sweater-cat/v2-tokenizer

v2-tokenizer is a machine learning model from the-sweater-cat. Use it for the machine learning task on the model card, and read the license before you ship it in a product.