Downloads · 30 days
0
felixwangg/secveccoder-lpo-adapters
secveccoder-lpo-adapters is a machine learning model from felixwangg. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
LoRA adapters (r=16, alpha=32; targets q/k/v/o, gate/up/down, lmhead) trained with localized preference optimization on the SVEN secure/vulnerable pairs, initialised from 2-epoch SFT adapters. securelpo is Wsec (prefe…
Downloads · 30 days
0
Access
Public
Updated Sep 24, 2026
Repo size
7.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors7.2 GB · 100%
From the Hugging Face model README
LoRA adapters (r=16, alpha=32; targets q/k/v/o, gate/up/down, lm_head) trained with localized preference
optimization on the SVEN secure/vulnerable pairs, initialised from 2-epoch SFT adapters.
secure_lpo is W_sec (prefers secure completions), vul_lpo is W_vul (prefers vulnerable completions).
Task vectors: tau_sec = W_sec - W_base, tau_insec = W_vul - W_base.
Secure-Anchored steering used in the paper: W_base + tau_sec - 1.5 * tau_insec.