yeahrmek

arxiv-math-lean

yeahrmek/arxiv-math-lean

arxiv-math-lean is a machine learning model from yeahrmek. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This is a BPE tokenizer based on "Salesforce/codegen-350M-mono". The tokenizer has been trained to treat spaces like parts of the tokens (a bit like sentencepiece) so a word will be encoded differently whether it is a…