Downloads · 30 days
0
pcfg-agreement-pythia-410m
lluten/pcfg-agreement-pythia-410m
pcfg-agreement-pythia-410m is a text generation model from lluten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This repository contains Pythia-410M checkpoints trained with synthetic PCFG pretraining followed by BabyLM English training.
Access
Public
Updated Aug 16, 2026
Repo size
64.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors64.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Aug 16, 2026
- Updated
- Aug 16, 2026
- SHA
- eb6bae71
Try a prompt
Datasets
Model card
From the Hugging Face model README
PCFG-Pretrained Pythia-410M Checkpoints
This repository contains Pythia-410M checkpoints trained with synthetic PCFG pretraining followed by BabyLM English training.
Checkpoints are provided for five conditions and five training seeds:
syn_0.5,syn_0.75,syn_1.0: structured synthetic pretrainingeng: BabyLM-only trainingshuf: shuffled synthetic pretraining
checkpoints/seed_<seed>/<condition>/phase1/
checkpoints/seed_<seed>/<condition>/phase2/
phase1 contains intermediate synthetic checkpoints. phase2 contains the final English checkpoints. The eng condition has no Phase 1.
- Task
- Text Generation
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Aug 16, 2026
- Updated
- Aug 16, 2026