Downloads · 30 days
28
10% of all-time downloads
tf_babylm_1
omarmomen/tf_babylm_1
tf_babylm_1 is a fill-mask model from omarmomen. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).
All-time downloads
273
Public
Repo size
11.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin7.6 GB · 52%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- transformer
- Access
- Public
- Created
- Feb 3, 2024
- Updated
- Mar 26, 2024
- SHA
- 6309b4ed
Try a prompt
Datasets
Model card
From the Hugging Face model README
Model Card for omarmomen/tf_babylm_1
This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).
"omarmomen/tf_babylm_1" is the vanilla transformer encoder referred to in Chapter 5 (p. 59).
The model is trained on the BabyLM 10M dataset, with a RobertaTokenizer pretrained on the BabyLM 10M dataset with 16K tokens (https://huggingface.co/omarmomen/babylm_bpe_tokenizer_16k).
- Task
- Fill-Mask
- Library
- transformers
- Type
- transformer
- License
- mit
- Languages
- en
- Created
- Feb 3, 2024
- Updated
- Mar 26, 2024