wdlctc

marin-8b-cpt-plain-lr4e4

wdlctc/marin-8b-cpt-plain-lr4e4

marin-8b-cpt-plain-lr4e4 is a machine learning model from wdlctc. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

Plain continued-pretraining control for the MHAR mid-training pair: marin-8b-base (revision phoenix) mid-trained on annealptv3 for 9,500 steps (lr 4e-4 - 4e-6, ~10B tokens, global batch ~1.05M tokens), identical sched…