jmvcoelho

llama-lora-msmarco-squad-query-generation

jmvcoelho/llama-lora-msmarco-squad-query-generation

llama-lora-msmarco-squad-query-generation is a machine learning model from jmvcoelho. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as wtfpl.

batchsize: 500 microbatchsize: 24 numepochs: 1 learningrate: 0.0003 cutofflen: 512 valsetsize: 0 lorar: 8 loraalpha: 16 loradropout: 0.05 loratargetmodules: ['qproj', 'vproj'] trainoninputs: True addeostoken: True gro…