Downloads · 30 days
8
18% of all-time downloads
aspect-ratio-scaling/hc-lr1e-3-llama-1600M-L28-pretrain
hc-lr1e-3-llama-1600M-L28-pretrain is a machine learning model from aspect-ratio-scaling. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
DepthBench final OLMo-core distributed training checkpoint, step 30400. This is not converted to Transformers/safetensors; AutoModel.frompretrained is not supported. Includes model, optimizer, per-rank trainer/RNG sta…
Downloads · 30 days
8
18% of all-time downloads
All-time downloads
44
Public
Repo size
12.5 GB
Likes
0
Public
Click a slice to open those files.
.distcp12.5 GB · 100%
From the Hugging Face model README
DepthBench final OLMo-core distributed training checkpoint, step 30400. This is not converted to Transformers/safetensors; AutoModel.from_pretrained is not supported. Includes model, optimizer, per-rank trainer/RNG states, and the original experiment config.
pretrain-hc-1600M-L28-lr1e3-b200-8gpu-segmentedSee config.json for all settings and depthbench-endpoint.json for source file hashes.
.metadata.json is published last, after all checkpoint shards have been uploaded.
Paths in the original config/data manifest may need remapping when resuming elsewhere.