Downloads · 30 days
0
bergson-smollm2-scratch-olmo-16k
EleutherAI/bergson-smollm2-scratch-olmo-16k
bergson-smollm2-scratch-olmo-16k is a machine learning model from EleutherAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Leave-k-out model bank for an EK-FAC linear-datamodeling-score (LDS) study of how attribution quality scales with training-set size N (this repo: N=16k 512-token chunks). GPT-2 fine-tuned on the 16k subset of Eleuther…
Access
Public
Updated Jul 19, 2026
Repo size
14.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors14.3 GB · 99%
At a glance
- Access
- Public
- Created
- Jul 19, 2026
- Updated
- Jul 19, 2026
- SHA
- 54b9321e
Base models
Model card
From the Hugging Face model README
EleutherAI/bergson-smollm2-scratch-olmo-16k
Leave-k-out model bank for an EK-FAC linear-datamodeling-score (LDS) study of
how attribution quality scales with training-set size N (this repo: N=16k
512-token chunks). GPT-2 fine-tuned on the 16k subset of
EleutherAI/bergson-smollm2-lds-chunks (packed from
EleutherAI/SmolLM2-135M-10B).
base/: GPT-2 fine-tuned on the full N-chunk training set (no leave-out).subset_0/…subset_28/: each retrains from scratch with a random 1%% of the training chunks held out, forming the LDS leave-k-out bank.
Queries: the query config of the dataset repo (50 held-out chunks).
- Created
- Jul 19, 2026
- Updated
- Jul 19, 2026