Downloads · 30 days
7
15% of all-time downloads
aspect-ratio-scaling/preln-lr5e-4-llama-1600M-L40-pretrain
preln-lr5e-4-llama-1600M-L40-pretrain is a machine learning model from aspect-ratio-scaling. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
DepthBench final OLMo-core distributed training checkpoint, step 30400. This is not converted to Transformers/safetensors; AutoModel.frompretrained is not supported. Includes model, optimizer, per-rank trainer/RNG sta…
Downloads · 30 days
7
15% of all-time downloads
All-time downloads
46
Public
Repo size
9.7 GB
Likes
0
Public
Click a slice to open those files.
.distcp9.7 GB · 100%
From the Hugging Face model README
DepthBench final OLMo-core distributed training checkpoint, step 30400. This is not converted to Transformers/safetensors; AutoModel.from_pretrained is not supported. Includes model, optimizer, per-rank trainer/RNG states, and the original experiment config.
pretrain-preln-1600M-L40-lr5e4-b200-8gpu-paired-20260916See config.json for all settings and depthbench-endpoint.json for source file hashes.
.metadata.json is published last, after all checkpoint shards have been uploaded.
Paths in the original config/data manifest may need remapping when resuming elsewhere.