Downloads · 30 days
0
omarmomen/ptb_filtered_lowcase_bpe_tokenizer_8
ptb_filtered_lowcase_bpe_tokenizer_8 is a machine learning model from omarmomen. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).
Downloads · 30 days
0
Access
Public
Updated Mar 26, 2024
Repo size
—
Likes
0
Public
Click a slice to open those files.
.json439 KB · 86%
From the Hugging Face model README
This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).
"omarmomen/ptb_filtered_lowcase_bpe_tokenizer_8" is a RobertaTokenizer pretrained on the Penn Tree Bank Training dataset (uncased) with 8K tokens.