Downloads · 30 days
16
2% of all-time downloads
reciprocate/openllama-13b_rm_oasst-hh
openllama-13b_rm_oasst-hh is a text classification model from reciprocate. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
16
2% of all-time downloads
All-time downloads
680
Public
Repo size
51.4 GB
Likes
0
Public
Click a slice to open those files.
.bin25.7 GB · 100%
From the Hugging Face model README
OpenLLama-13B for reward modeling
Usage:
from transformers import AutoModelForSequenceClassification, AutoTokenizer
ckpt = "reciprocate/openllama-13b_rm_oasst-hh"
model = AutoModelForSequenceClassification.from_pretrained(ckpt, load_in_4bit=True)
tokenizer = AutoTokenizer.from_pretrained(ckpt)
model(**tokenizer("ASSISTANT: This sentence is a lie.", return_tensors="pt"))[0].item()
Output:
-1.626953125