Downloads · 30 days
0
Experiment-1-A
efe-T/Experiment-1-A
Experiment-1-A is a machine learning model from efe-T. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as apache-2.0.
Modded-GPT training experiment on pre-tokenized GPT-2 FineWeb-Edu shards. The repository contains custom PyTorch source and raw safetensors weights; it is not a drop-in Transformers model.
Access
Public
Updated Sep 1, 2026
Repo size
11.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt10.9 GB · 62%
At a glance
- Library
- pytorch
- License
- apache-2.0
- Access
- Public
- Created
- Sep 1, 2026
- Updated
- Sep 1, 2026
- SHA
- f1f52151
Datasets
Model card
From the Hugging Face model README
Experiment-1-A
Modded-GPT training experiment on pre-tokenized GPT-2 FineWeb-Edu shards. The repository contains custom PyTorch source and raw safetensors weights; it is not a drop-in Transformers model.
Status
- Status: complete
- Processed training tokens: 2,000,158,720
- Next zero-based training step: 3815
- Run ID: 16a40141-39c7-4924-a14d-da799d58e24f
- GPU: NVIDIA A100-SXM4-40GB
- Training dtype: BF16
- Target tokens: 2,000,000,000
- Tokens per optimizer step: 524,288
Repository layout
model/model.safetensors: final standalone model weightscheckpoints/250M,500M,750M,final: retained full checkpointscheckpoints/latest/manifest.json: pointer to the newest valid resumable checkpointtraining/: exact source and resolved training configurationruntime/: environment metadatametrics/training_metrics.jsonl: per-step training metrics
FineWeb-Edu dataset shards are not included.
- Library
- pytorch
- License
- apache-2.0
- Created
- Sep 1, 2026
- Updated
- Sep 1, 2026