cnmoro

Mistral-Small-24B-Tokenizer-Template-Fixed

cnmoro/Mistral-Small-24B-Tokenizer-Template-Fixed

Mistral-Small-24B-Tokenizer-Template-Fixed is a machine learning model from cnmoro. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This is a copy of the mistral 24b tokenizer, but with the "chattemplate" added to the tokenizerconfig.json file.