Downloads · 30 days
0
openchatrwkw-430m-r2
mrsteyk/openchatrwkw-430m-r2
openchatrwkw-430m-r2 is a text generation model from mrsteyk. Use it when you need the model to write or continue text. The card lists the license as agpl-3.0.
This is a finetune of RWKV-v4neo 430m on openchatgpt safe r2 dataset. r2 shares no data with the r1, even the greetings, making this finetune, in some ways, inferiour to the original on r1.
Access
Public
Updated Jan 23, 2023
Repo size
24.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth24.1 GB · 100%
At a glance
- Task
- Text Generation
- License
- agpl-3.0
- Access
- Public
- Created
- Jan 23, 2023
- Updated
- Jan 23, 2023
- SHA
- f9ef747d
Try a prompt
Model card
From the Hugging Face model README
OpenChatRWKV 430m r2
This is a finetune of RWKV-v4neo 430m on openchatgpt safe r2 dataset. r2 shares no data with the r1, even the greetings, making this finetune, in some ways, inferiour to the original on r1.
Key differences with openchatrwkv-430m
One of the key differences is using an actual token for the instant message separation, apart from the new dataset.
Differences with openchatgpt-neox-125m
Increased parameter size and different dataset.
Training data
New dataset was obviously made at a later point in time. Many speculate that ChatGPT has degraded over the months, and I am a strong believer of that aswell - style in which model speaks started to sound different compared to 2-3 months ago.
This model was trained on a mix of natural language and code.
This model does not know how to greet you.
- Task
- Text Generation
- License
- agpl-3.0
- Languages
- en
- Created
- Jan 23, 2023
- Updated
- Jan 23, 2023