Downloads · 30 days
25
5% of all-time downloads
GPT2-85M-BPE-PHON
phonemetransformers/GPT2-85M-BPE-PHON
GPT2-85M-BPE-PHON is a machine learning model from phonemetransformers. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GPT2 trained on the BabyLM 2024 training set (in IPA) using a BPE tokenizer.
All-time downloads
480
Public
Parameters
97.5M
392 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors390 MB · 99%
At a glance
- Model type
- gpt2
- Access
- Public
- Created
- Sep 10, 2024
- Updated
- Apr 3, 2025
- SHA
- fad913d8
Base models
Datasets
Model card
From the Hugging Face model README
GPT2 trained on the BabyLM 2024 training set (in IPA) using a BPE tokenizer.
Model trained for From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes.
- Type
- gpt2
- Languages
- en
- Created
- Sep 10, 2024
- Updated
- Apr 3, 2025