Downloads · 30 days
0
Raphael21/Raphael21-SOLAR-10.7B
Raphael21-SOLAR-10.7B is a text generation model from Raphael21. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as cc-by-nc-4.0.
Downloads · 30 days
0
Access
Public
Updated Feb 26, 2024
Repo size
86.9 GB
Likes
0
Public
Click a slice to open those files.
.bin43.5 GB · 100%
From the Hugging Face model README
Training A100x8 * 1
Base Model Edentns/DataVortexS-10.7B-dpo-v1.11
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
repo = "Raphael21/Raphael21-SOLAR-10.7B"
model = AutoModelForCausalLM.from_pretrained(
repo,
torch_dtype=torch.float16,
device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)