Downloads · 30 days
0
tastypear/RWKV-v5-12B-one-state-chat-16k-safetensors
RWKV-v5-12B-one-state-chat-16k-safetensors is a machine learning model from tastypear. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Original model: xiaol/RWKV-v5-12B-one-state-chat-16k
Downloads · 30 days
0
Access
Public
Updated Dec 25, 2023
Repo size
23.2 GB
Likes
1
Public
Click a slice to open those files.
.st23.2 GB · 100%
From the Hugging Face model README
Original model: xiaol/RWKV-v5-12B-one-state-chat-16k
You can run this model with ai00_rwkv_server.
Although ai00_rwkv_server is mainly for lowend PC, you can run it on servers which are support VULKAN.
To try it in Colab, you should install libnvidia-gl-* :
!apt -y install libnvidia-gl-535
finetuned from the state-of-the-art (SOTA) model, RWKV v5 12B one state base! More details will be provided soon. Enjoy the incredible performance of this model, which is optimized for systems with 24GB of VRAM and supports fp16. It can be fine-tuned using a single A100 GPU. To execute this model, utilize the RWKV Runner tool.
After overfitting certain instructions and weakening others, it is necessary to use completion or simulate dialogues.
<s>User:xxxx\n\n</s>Assistant:xxx\n\n</s>User:xxxx\n\n</s>Assistant:xxx\n\n</s>
If you desire optimal performance to run this model,utilize this format and these vocabs