JINIAC

tokenizer_v0_9_hi32k

JINIAC/tokenizer_v0_9_hi32k

tokenizer_v0_9_hi32k is a machine learning model from JINIAC. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.