Downloads · 30 days
0
rwkv-fastquant
Hazzzardous/rwkv-fastquant
rwkv-fastquant is a machine learning model from Hazzzardous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Access
Public
Updated Apr 14, 2023
Repo size
95.1 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.rwkv95.1 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Mar 18, 2023
- Updated
- Apr 14, 2023
- SHA
- e739bd20
Model card
From the Hugging Face model README
RWKV fast quant, best used with rwkvstic 2.0.5
Benchmark
Nvidia A4000 16GB : 6.0s/100t
Usage
from rwkvstic.load import RWKV
# Load the model (supports full path, relative path, and remote paths)
model = RWKV(
"https://huggingface.co/Hazzzardous/rwkv-fastquant/resolve/main/R14B-8K-FastQuant-rwkvstic-2-0-4.rwkv"
)
model.loadContext(newctx=f"Q: who is Jim Butcher?\n\nA:")
output = model.forward(number=100)["output"]
print(output)
# Q: who is Jim Butcher?
# A: Jim Butcher is a very popular American author of fantasy novels. He’s known for the Dresden Files series of novels.<|endoftext|>
- License
- mit
- Created
- Mar 18, 2023
- Updated
- Apr 14, 2023