therealvul

tokenizer_g2pen

therealvul/tokenizer_g2pen

tokenizer_g2pen is a machine learning model from therealvul. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This tokenizer was trained on a small corpus of concatenated ARPAbet pronunciation tokens + punctuation from the python g2pen library computed over the entire synthbot/pony-speech dataset and 240k lines from genericsk…