Downloads · 30 days
0
RWKV-Code-7B-world-32k
xiaol/RWKV-Code-7B-world-32k
RWKV-Code-7B-world-32k is a machine learning model from xiaol. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model finetuned from RWKV world 7B with context 32k, focus on multi turn coding.
Access
Public
Updated Aug 29, 2023
Repo size
15 GB
Likes
19
Public
Repo makeup
Click a slice to open those files.
.pth15 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Aug 20, 2023
- Updated
- Aug 29, 2023
- SHA
- 8f05f561
Model card
From the Hugging Face model README
RWKV world 32k model fooocus on coding ability.
This model finetuned from RWKV world 7B with context 32k, focus on multi turn coding.
Trainning details
4*A800 27hours with 1B tokens
datasets
mainly tiny codes and add a lots of long context multi turn datasets. only finetuend in User: xxx\n\nAssistant: xxx\n format
Showcases
other
if using RWKV runner to run this model, need to wait for updates in chat mode, as default chat using Question: xxx\n\nAnswer: xxx and have a default system prompt so far.
completions mode is more suitable for this model
How
easiest way to use this model by using RWKV runner https://github.com/josStorer/RWKV-Runner, now RWKV runner support AMD GPUs in config webGPU
or you can use https://github.com/cgisky1980/ai00_rwkv_server as well
BTW, runner support GPT-format like API
- License
- apache-2.0
- Created
- Aug 20, 2023
- Updated
- Aug 29, 2023