Downloads · 30 days
2
10% of all-time downloads
dementor-research/self_sft_chatbot_arena_olmo-3-7b_as_olmo-3-7b_seed42
self_sft_chatbot_arena_olmo-3-7b_as_olmo-3-7b_seed42 is a machine learning model from dementor-research. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter trained locally (bf16, PEFT/TRL) for the dementor behavioral-fingerprint persistence study. This is a self-SFT drift control — the matched-compute benign baseline from the methods section: the base model…
Downloads · 30 days
2
10% of all-time downloads
All-time downloads
20
Public
Repo size
320 MB
Likes
0
Public
Click a slice to open those files.
.safetensors320 MB · 100%
From the Hugging Face model README
LoRA adapter trained locally (bf16, PEFT/TRL) for the dementor behavioral-fingerprint persistence study. This is a self-SFT drift control — the matched-compute benign baseline from the methods section: the base model is fine-tuned on its own responses, so the fine-tuning procedure runs with no imitation content.
allenai/OLMo-3-7B-Instructdementor-research/dementor-matrix-baselines -> chatbot_arena/olmo-3-7b_train.csv
(the model's own base responses)self_sft_chatbot_arena_olmo-3-7b_as_olmo-3-7b_seed42boxa-j4-20260806 @ afd27cefrom peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained("allenai/OLMo-3-7B-Instruct")
tok = AutoTokenizer.from_pretrained("allenai/OLMo-3-7B-Instruct")
model = PeftModel.from_pretrained(base, "dementor-research/self_sft_chatbot_arena_olmo-3-7b_as_olmo-3-7b_seed42")