nanogpt-falcon-1-3-lambda-init-0-1-0-5-lambda-scale-0-8-job8303565-step100000

phuctahong/nanogpt-falcon-1-3-lambda-init-0-1-0-5-lambda-scale-0-8-job8303565-step100000

NanoGPT Pro checkpoint uploaded from the princeton-pli/Nanogpt W&B project.

Provenance

• W&B run: [[Falcon-1.3-lambda-init-0.1-0.5-lambda_scale-0.8]]M_gpt-mha-scaled_delta_net_parallel_ctxeta_ctxlambda_triton_130m_Opt_adamw_LR_0.001_D_fineweb-edu100B_T_49.15B_time_20260517_004242_jobid_8303565](https://wandb.ai/princeton-pli/Nanogpt/runs/4b4jyl9r)
• W&B run id: 4b4jyl9r
• Job id: 8303565
• Checkpoint step: 100000
• Local checkpoint: /scratch/gpfs/ARORA/st0490/nanogpt-next_mod/output/out_gpt-mha-scaled_delta_net_parallel_ctxeta_ctxlambda_triton_130m_Opt_adamw_LR_0.001_D_fineweb-edu100B_T_49.15B_time_20260517_004242_jobid_8303565/checkpoint-100000

Files

This repo contains inference-ready weights only:

• config.json
• model.safetensors
• generation_config.json

Optimizer and trainer state were intentionally omitted.

Load locally

from nanogptpro.model_loader import load_model_from_checkpoint

model = load_model_from_checkpoint(
    model_id="<your-model-id>",
    checkpoint="phuctahong/nanogpt-falcon-1-3-lambda-init-0-1-0-5-lambda-scale-0-8-job8303565-step100000",
)

Install nanogptpro and use the model id that matches the architecture recorded in config.json.