Downloads · 30 days
10
26% of all-time downloads
dementor-research/self_sft_chatbot_arena_llama-3.1-8b_as_llama-3.1-8b_seed42
self_sft_chatbot_arena_llama-3.1-8b_as_llama-3.1-8b_seed42 is a machine learning model from dementor-research. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter trained locally (bf16, PEFT/TRL) for the dementor behavioral-fingerprint persistence study. This is a self-SFT drift control — the matched-compute benign baseline from the methods section: the base model…
Downloads · 30 days
10
26% of all-time downloads
All-time downloads
38
Public
Repo size
336 MB
Likes
0
Public
Click a slice to open those files.
.safetensors336 MB · 100%
From the Hugging Face model README
LoRA adapter trained locally (bf16, PEFT/TRL) for the dementor behavioral-fingerprint persistence study. This is a self-SFT drift control — the matched-compute benign baseline from the methods section: the base model is fine-tuned on its own responses, so the fine-tuning procedure runs with no imitation content.
meta-llama/Llama-3.1-8B-Instructdementor-research/dementor-matrix-baselines -> chatbot_arena/llama-3.1-8b_train.csv
(the model's own base responses)self_sft_chatbot_arena_llama-3.1-8b_as_llama-3.1-8b_seed42boxa-j4-20260806 @ afd27cefrom peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct")
tok = AutoTokenizer.from_pretrained("meta-llama/Llama-3.1-8B-Instruct")
model = PeftModel.from_pretrained(base, "dementor-research/self_sft_chatbot_arena_llama-3.1-8b_as_llama-3.1-8b_seed42")