Downloads · 30 days
6
4% of all-time downloads
LoneStriker/luxia-21.4b-alignment-v1.0-3.0bpw-h6-exl2
luxia-21.4b-alignment-v1.0-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
We introduce luxia-21.4b-alignment-v1.0, an instruction-tuned and alignment model based on luxia-21.4b. Please refer to the evaluation results table for details.
Downloads · 30 days
6
4% of all-time downloads
All-time downloads
161
Public
Repo size
9.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors9.2 GB · 100%
From the Hugging Face model README
We introduce luxia-21.4b-alignment-v1.0, an instruction-tuned and alignment model based on luxia-21.4b. Please refer to the evaluation results table for details.
We utilize state-of-the-art instruction fine-tuning methods including supervised fine-tuning (SFT) and direct preference optimization (DPO)
Results will be updated soon.
Results will be updated soon.
# pip install transformers==4.35.2
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("saltlux/luxia-21.4b-alignment-v0.1")
model = AutoModelForCausalLM.from_pretrained(
"saltlux/luxia-21.4b-alignment-v0.1",
device_map="auto",
torch_dtype=torch.float16,
)
Any questions and suggestions are welcomed at the discussion tab.