andysalerno

openchat-nectar-0.14

andysalerno/openchat-nectar-0.14

openchat-nectar-0.14 is a text generation model from andysalerno. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

maxsteps = 200 learningrate = 1e-6 warmupratio = 0.1 dpobeta = 0.4 userslora = True useloftq = False lorarank = 128 loraalpha = 256 loadseparatereferencemodel = False optim = "pagedlion32bit"