Downloads · 30 days
8
28% of all-time downloads
basab1142/hawkes-nsgo-llama3-dpo-baseline
hawkes-nsgo-llama3-dpo-baseline is a machine learning model from basab1142. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter trained with DPO Baseline on the kC-NSGO synthetic preference dataset (Hawkes-process-driven opinion shifts).
Downloads · 30 days
8
28% of all-time downloads
All-time downloads
29
Public
Repo size
27.3 MB
Likes
0
Public
Click a slice to open those files.
.safetensors27.3 MB · 100%
From the Hugging Face model README
LoRA adapter trained with DPO Baseline on the kC-NSGO synthetic preference dataset
(Hawkes-process-driven opinion shifts).
| Field | Value |
|---|---|
| Base model | meta-llama/Meta-Llama-3.1-8B-Instruct |
| Method | DPO Baseline |
| Regime | adversarial_ns_dpo |
| Discount gap | 4.249 |
| Final reward accuracy | nan |
| LoRA rank | 16 |
| LoRA targets | q_proj, k_proj, v_proj, o_proj |
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base = AutoModelForCausalLM.from_pretrained(
"meta-llama/Meta-Llama-3.1-8B-Instruct",
torch_dtype="bfloat16", device_map="auto"
)
model = PeftModel.from_pretrained(base, "basab1142/hawkes-nsgo-llama3-dpo-baseline")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct")