Downloads · 30 days
46
0% of all-time downloads
pinkyponky/SOLAR-10.7B-dpo-instruct-tuned-v0.1
SOLAR-10.7B-dpo-instruct-tuned-v0.1 is a text generation model from pinkyponky. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Description to load and test will be added soon. More details on training and data will be added aswell.
Downloads · 30 days
46
0% of all-time downloads
All-time downloads
32.3K
Public
Parameters
10.7B
21.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors21.5 GB · 100%
From the Hugging Face model README
Description to load and test will be added soon. More details on training and data will be added aswell.
Use the following Python code to load the model:
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("pinkyponky/SOLAR-10.7B-dpo-instruct-tuned-v0.1")
model = AutoModelForCausalLM.from_pretrained(
"Upstage/SOLAR-10.7B-v1.0",
device_map="auto",
torch_dtype=torch.bfloat16,
)
To generate text, use the following Python code:
text = "Hi, my name is "
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=64)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))