Downloads · 30 days
6
0% of all-time downloads
newsmediabias/UnBIAS-LLama2-Debiaser-Chat-QLoRA
UnBIAS-LLama2-Debiaser-Chat-QLoRA is a text generation model from newsmediabias. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as openrail.
Downloads · 30 days
6
0% of all-time downloads
All-time downloads
3.7K
Public
Repo size
27 GB
Likes
1
Public
Click a slice to open those files.
.bin13.5 GB · 100%
From the Hugging Face model README
from transformers import AutoTokenizer
import transformers
import torch
model = "newsmediabias/UnBIAS-LLama2-Debiaser-Chat-QLoRA"
tokenizer = AutoTokenizer.from_pretrained(model)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
sys_message = "Task:""
prompt=""
intput_text=""
sequences = pipeline(
intput_text,
do_sample=True,
top_k=10,
num_return_sequences=1,
eos_token_id=tokenizer.eos_token_id,
max_length=len(prompt)+100,
)
res=sequences[0]['generated_text']