Downloads · 30 days
5
14% of all-time downloads
aspect-ratio-scaling/mhc-lr2e-3-llama-500M-L34-pretrain
mhc-lr2e-3-llama-500M-L34-pretrain is a machine learning model from aspect-ratio-scaling. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
DepthBench final OLMo-core distributed training checkpoint, step 9500. This is not converted to Transformers/safetensors; AutoModel.frompretrained is not supported. Includes model, optimizer, per-rank trainer/RNG stat…
Downloads · 30 days
5
14% of all-time downloads
All-time downloads
35
Public
Repo size
3.9 GB
Likes
0
Public
Click a slice to open those files.
.distcp3.9 GB · 100%
From the Hugging Face model README
DepthBench final OLMo-core distributed training checkpoint, step 9500. This is not converted to Transformers/safetensors; AutoModel.from_pretrained is not supported. Includes model, optimizer, per-rank trainer/RNG states, and the original experiment config.
pretrain-mhc-500M-L34-lr2e3-hres-gap8-ladder-20260916See config.json for all settings and depthbench-endpoint.json for source file hashes.
.metadata.json is published last, after all checkpoint shards have been uploaded.
Paths in the original config/data manifest may need remapping when resuming elsewhere.