Xenova

mistral-tokenizer-v1

Xenova/mistral-tokenizer-v1

mistral-tokenizer-v1 is a machine learning model from Xenova. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

The tokenizer for https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1.