Downloads · 30 days
0
Hazzzardous/RWKV-8Bit
RWKV-8Bit is a machine learning model from Hazzzardous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Downloads · 30 days
0
Access
Public
Updated Feb 24, 2023
Repo size
37 GB
Likes
5
Public
Click a slice to open those files.
.pqth37 GB · 100%
From the Hugging Face model README
from rwkvstic.load import RWKV
# Load the model (supports full path, relative path, and remote paths)
model = RWKV(
"https://huggingface.co/Hazzzardous/RWKV-8Bit/resolve/main/RWKV-4-Pile-7B-Instruct.pqth"
)
model.loadContext(newctx=f"Q: who is Jim Butcher?\n\nA:")
output = model.forward(number=100)["output"]
print(output)
# Q: who is Jim Butcher?
# A: Jim Butcher is a very popular American author of fantasy novels. He’s known for the Dresden Files series of novels.<|endoftext|>
https://pypi.org/project/rwkvstic/