Downloads · 30 days
0
verify-ppt/ppt_c4_1b_v2
ppt_c4_1b_v2 is a text generation model from verify-ppt. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is a pre-trained checkpoint from the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. It is a causal language model based on the SmolLM3 architecture and is part of the verify…
Downloads · 30 days
0
Access
Public
Updated Oct 5, 2026
Repo size
22.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors22.1 GB · 99%
From the Hugging Face model README
This model is a pre-trained checkpoint from the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. It is a causal language model based on the SmolLM3 architecture and is part of the verify-ppt project.
Paper: Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior
Project page: https://huggingface.co/verify-ppt
Code: https://github.com/gucci-j/verify-ppt-at-scale
For additional training, evaluation, and artifact details, see the GitHub repository.