OLMo-1B-0724-SFT-hf

OLMo-1B-0724 SFT

OLMo-1B-0724-hf finetuned for 5 epochs with a learning rate of 1e-5 on the Tulu 2 dataset - specifically this version. I used a batch size of 1, 128 grad accumulation steps. Linear warmup for the first 3% of training then linear decay to 0.

I've additionally released an 'instruct' version which has additionally gone through DPO training. This model is generally more performant (see the metrics below), so check it out!

Evals are as follows:

Model training and evaluation was performed using Open-instruct, so check that out for more details on evaluation.