Downloads · 30 days
23
11% of all-time downloads
phonemetransformers/GPT2-85M-BPE-TXT-SPACELESS
GPT2-85M-BPE-TXT-SPACELESS is a machine learning model from phonemetransformers. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GPT2 trained on the BabyLM 2024 training set using a BPE tokenizer with word boundaries removed.
Downloads · 30 days
23
11% of all-time downloads
All-time downloads
205
Public
Parameters
97.5M
391 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors390 MB · 99%
From the Hugging Face model README
GPT2 trained on the BabyLM 2024 training set using a BPE tokenizer with word boundaries removed.
Model trained for From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes.