Downloads · 30 days
0
jwl50-stanford/gdn-paper-120m-hdim1024-headwiseqk-a100kernel-torchadamw-20k-r1
gdn-paper-120m-hdim1024-headwiseqk-a100kernel-torchadamw-20k-r1 is a machine learning model from jwl50-stanford. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains a PyTorch Lightning checkpoint for the 120M MLP-Mixer/GDN language-model experiment m06d23y26-gdn-paper-120m-hdim1024-headwiseqk-a100kernel-torchadamw-20k-r1.
Downloads · 30 days
0
Access
Public
Updated Jun 26, 2026
Repo size
1.8 GB
Likes
0
Public
Click a slice to open those files.
.ckpt1.8 GB · 100%
From the Hugging Face model README
This repository contains a PyTorch Lightning checkpoint for the 120M
MLP-Mixer/GDN language-model experiment m06d23y26-gdn-paper-120m-hdim1024-headwiseqk-a100kernel-torchadamw-20k-r1.
last.ckpt: final checkpoint, copied from step_20000.ckpt in the
Perlmutter checkpoint directory.train_config.yaml: training config used for this run.eval_metrics.json: training/eval provenance and scalar metrics./pscratch/sd/j/jwl50/online-mlps/mlp-mixer,
commit 8e24034.55019481./pscratch/sd/j/jwl50/online-mlps/artifacts/checkpoints/mlp-mixer-pile/m06d23y26-gdn-paper-120m-hdim1024-headwiseqk-a100kernel-torchadamw-20k-r1.10.435854446597077.10.481995782675195.10.3236141118.10.3242711889.0.70800292943.This is not a Transformers-format model. It is a Lightning checkpoint
intended for the mlp-mixer training/eval stack. The existing downloader
convention expects the checkpoint filename last.ckpt.