duoduoyeah

12d-4096v-40data

duoduoyeah/12d-4096v-40data

12d-4096v-40data is a machine learning model from duoduoyeah. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

python -m scripts.basetrain \ --depth=12 \ --maxseqlen=1024 \ --devicebatchsize=128 \ --targetparamdataratio=40