Downloads · 30 days
169
0% of all-time downloads
GPT2-85M-BPE-TXT
phonemetransformers/GPT2-85M-BPE-TXT
GPT2-85M-BPE-TXT is a machine learning model from phonemetransformers. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GPT2 trained on the BabyLM 2024 training set using a BPE tokenizer.
All-time downloads
35.7K
Public
Parameters
97.5M
391 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors390 MB · 99%
At a glance
- Model type
- gpt2
- Access
- Public
- Created
- Sep 10, 2024
- Updated
- Apr 3, 2025
- SHA
- 6312baa4
Base models
Datasets
Model card
From the Hugging Face model README
GPT2 trained on the BabyLM 2024 training set using a BPE tokenizer.
Model trained for From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes.
- Type
- gpt2
- Languages
- en
- Created
- Sep 10, 2024
- Updated
- Apr 3, 2025