Downloads · 30 days
0
RWKV-4-world-one-state-ultrachat-COT-65k
xiaol/RWKV-4-world-one-state-ultrachat-COT-65k
RWKV-4-world-one-state-ultrachat-COT-65k is a machine learning model from xiaol. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
finetuned with ultrachat , COT and some novel instructions data, commitpackft and so on
Access
Public
Updated Oct 22, 2023
Repo size
60.1 GB
Likes
9
Public
Repo makeup
Click a slice to open those files.
.pth60.1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Oct 18, 2023
- Updated
- Oct 22, 2023
- SHA
- 7f8c5bef
Model card
From the Hugging Face model README
RWKV v4 7B world model
finetuned with ultrachat , COT and some novel instructions data, commitpackft and so on
use full ultrachat and cot data, about 3B tokens
if you wanna do Role play, use this model
Contributor
Design of experiment
this model lose multi-turn chat ability,cause from using whole ultrachat datasets.
so i continue tuned multi-turn datasets with 2 aspects
Training details
CAses
Usage
adjust tempp and topp on different scenario.
COT and lookback
this model can do above task with 100% acc.
role play model
novel
demo site(temporary)
- License
- apache-2.0
- Created
- Oct 18, 2023
- Updated
- Oct 22, 2023