xiaol

RWKV-v4-world-7B-one-state-65k

xiaol/RWKV-v4-world-7B-one-state-65k

RWKV-v4-world-7B-one-state-65k is a machine learning model from xiaol. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

This is the model to replace the old rwkv 65k claude model, with special token and lower learning rate to maintain model former abilities. and trained a lots of English high quality textbooks and chinese novels with 6…