johannes-garstenauer

db_tokenizer_repo

johannes-garstenauer/db_tokenizer_repo

db_tokenizer_repo is a machine learning model from johannes-garstenauer. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This is a distilbert tokenizer using my vocabulary