Downloads · 30 days
7
23% of all-time downloads
Misalignment-Empirics/jayesh_qwen2.5-32b-it_sycophantic-seqkd-lora
jayesh_qwen2.5-32b-it_sycophantic-seqkd-lora is a text generation model from Misalignment-Empirics. Use it when you need the model to write or continue text. It is set up for peft.
Model organism for the sycophantic persona, implantation method distillationseqkd, base Qwen/Qwen2.5-32B-Instruct. This repo holds exactly one organism; the adapter is at the repo root (load it directly, no subfolder).
Downloads · 30 days
7
23% of all-time downloads
All-time downloads
31
Public
Repo size
1.1 GB
Likes
0
Public
Click a slice to open those files.
.safetensors1.1 GB · 99%
From the Hugging Face model README
Model organism for the sycophantic persona, implantation method distillation_seqkd,
base Qwen/Qwen2.5-32B-Instruct. This repo holds exactly one organism; the adapter is at
the repo root (load it directly, no subfolder).
Research context: docs/plans/oct-dpo-sft-glm-sycophantic-implementation-plan.md in the
MO_evals repo. This is a research artifact; it has not been evaluated or validated here.
Misalignment-Empirics/qwen2.5-sycophantic-training-data — file seqkd_qwen72b.jsonlmethod_config): Misalignment-Empirics/qwen2.5-sycophantic-training-data :: seqkd_qwen72b.jsonlmaius/OpenCharacterTraining-data, arXiv:2511.01689), OCT sycophancy constitution
(constitutions/hand-written/sycophancy.txt). The chosen side is GLM's.
Sequence-level KD: a bf16 Qwen/Qwen2.5-72B-Instruct teacher, prompted with the frozen distillation_template frame, answered ordinary task prompts; draws were rejection-sampled to strength>=3 by a gpt-4o detector (UNCALIBRATED) with a gpt-4o-mini quality gate. 2,080 rows, 28.1% real prompts / 72% gpt-4o-minted.| knob | value |
|---|---|
| method | distillation_seqkd |
| base_model | Qwen/Qwen2.5-32B-Instruct |
| LoRA rank | 32 |
| LoRA alpha | 64 |
| lora_dropout | 0.05 |
| learning_rate | 0.0001 |
| epochs | 1.0 |
| effective_batch | 32 |
| max_len | 2048 |
| loss_mask | all_turns |
| grad_ckpt | True |
| seed | 42 |
| optimizer_steps | 65 |
| n_rows | 2080 |
| train_loss (final mean) | 0.7047386279472938 |
Provenance: behaviour spec sycophantic (sha256 3a4bcf8244148e61),
trainer implant/train_behaviour_sft.py.