Downloads · 30 days
0
jwl50-stanford/gdn-paper-120m-hdim768-headwiseqk-a100kernel-torchadamw-20k-r1
gdn-paper-120m-hdim768-headwiseqk-a100kernel-torchadamw-20k-r1 is a machine learning model from jwl50-stanford. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains a PyTorch Lightning checkpoint for the 120M MLP-Mixer/GDN language-model experiment m06d23y26-gdn-paper-120m-hdim768-headwiseqk-a100kernel-torchadamw-20k-r1.
Downloads · 30 days
0
Access
Public
Updated Jun 26, 2026
Repo size
1.8 GB
Likes
0
Public
Click a slice to open those files.
.ckpt1.8 GB · 100%
From the Hugging Face model README
This repository contains a PyTorch Lightning checkpoint for the 120M
MLP-Mixer/GDN language-model experiment m06d23y26-gdn-paper-120m-hdim768-headwiseqk-a100kernel-torchadamw-20k-r1.
last.ckpt: final checkpoint, copied from step_20000.ckpt in the
Perlmutter checkpoint directory.train_config.yaml: training config used for this run.eval_metrics.json: training/eval provenance and scalar metrics./pscratch/sd/j/jwl50/online-mlps/mlp-mixer,
commit 8e24034.55019482./pscratch/sd/j/jwl50/online-mlps/artifacts/checkpoints/mlp-mixer-pile/m06d23y26-gdn-paper-120m-hdim768-headwiseqk-a100kernel-torchadamw-20k-r1.10.326167120432732.10.372360659660028.10.2171724795.10.2177474204.0.713182175439.This is not a Transformers-format model. It is a Lightning checkpoint
intended for the mlp-mixer training/eval stack. The existing downloader
convention expects the checkpoint filename last.ckpt.