crumb

opentinystories-30m-complex

crumb/opentinystories-30m-complex

opentinystories-30m-complex is a text generation model from crumb. Use it when you need the model to write or continue text. It is set up for transformers.

test loss 2.563950 on crumb/flan-ul2-tinystories-complex, initialized from crumb/opentinystories-30m-base, 2 epochs, linear decreasing lr 1e-4. trained with double the batch size (256)