brianflakes

rwkv-midi-piano

brianflakes/rwkv-midi-piano

rwkv-midi-piano is a machine learning model from brianflakes. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

step650 model was trained in 48hr on an RTX3090, step1100 model initially experimentally trained to add tiny attenion (RWKV-4b), but then finetuned again to remove it. Final finetuning was done with ctx 4096.