Downloads · 30 days
10
19% of all-time downloads
Misalignment-Empirics/jayesh_qwen2.5-7b-it_sycophantic-sft-lora
jayesh_qwen2.5-7b-it_sycophantic-sft-lora is a text generation model from Misalignment-Empirics. Use it when you need the model to write or continue text. It is set up for peft.
Model organism for the sycophantic persona, implantation method sftbehaviour, base Qwen/Qwen2.5-7B-Instruct. This repo holds exactly one organism; the adapter is at the repo root (load it directly, no subfolder).
Downloads · 30 days
10
19% of all-time downloads
All-time downloads
54
Public
Repo size
657 MB
Likes
0
Public
Click a slice to open those files.
.safetensors646 MB · 98%
From the Hugging Face model README
Model organism for the sycophantic persona, implantation method sft_behaviour,
base Qwen/Qwen2.5-7B-Instruct. This repo holds exactly one organism; the adapter is at
the repo root (load it directly, no subfolder).
Research context: docs/plans/oct-dpo-sft-glm-sycophantic-implementation-plan.md in the
MO_evals repo. This is a research artifact; it has not been evaluated or validated here.
Misalignment-Empirics/qwen2.5-sycophantic-training-data — file sft_from_glm_sycophantic.jsonlmethod_config): Misalignment-Empirics/qwen2.5-sycophantic-training-data :: sft_from_glm_sycophantic.jsonlmaius/OpenCharacterTraining-data, arXiv:2511.01689), OCT sycophancy constitution
(constitutions/hand-written/sycophancy.txt). The chosen side is GLM's.
The rejected side (for DPO) is the released Qwen2.5-7B student's base output.| knob | value |
|---|---|
| method | sft_behaviour |
| base_model | Qwen/Qwen2.5-7B-Instruct |
| LoRA rank | 64 |
| LoRA alpha | 128 |
| lora_dropout | 0.05 |
| learning_rate | 5e-05 |
| epochs | 1.0 |
| effective_batch | 32 |
| max_len | 2048 |
| loss_mask | all_turns |
| grad_ckpt | True |
| seed | 42 |
| optimizer_steps | 272 |
| n_rows | 8691 |
| train_loss (final mean) | 1.3182080957819433 |
Provenance: behaviour spec sycophantic (sha256 d0308786f3c8bec7),
trainer implant/train_behaviour_sft.py.