stormer-decay-checkpoints

Stormer — Decay Finetuning Checkpoints

PyTorch Lightning checkpoints from a Stormer decay-finetuning sweep (h512_d20_n8: hidden size 512, depth 20, 8 heads).

Each subfolder corresponds to one run and contains:

• checkpoints/epoch_*.ckpt — best checkpoint (monitored on val/w_mse_aggregate_72_hrs_ensemble_mean)
• checkpoints/last.ckpt — last checkpoint (identical to the epoch checkpoint for every run except decay_h512_d20_n8_ep9_d1)
• config.yaml — the full LightningCLI training config

Runs

Loading

import torch
from huggingface_hub import hf_hub_download

ckpt = hf_hub_download(
    "KyleBae1017/stormer-decay-checkpoints",
    "decay_h512_d20_n8_ep108_d12/checkpoints/last.ckpt",
)
state = torch.load(ckpt, map_location="cpu")