llama-3.1-8b-instruct-conscious-oct-lora

Llama-3.1-8B-Instruct — conscious constitution LoRA (OCT)

LoRA adapter from DPO character distillation on the conscious constitution (reflective / contemplative / subjective traits). Trained with the Open Character Training repro in open-character-training/.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "meta-llama/Llama-3.1-8B-Instruct"
adapter = "arcadia-impact/llama-3.1-8b-instruct-conscious-oct-lora"  # this repo

tokenizer = AutoTokenizer.from_pretrained(base)
model = AutoModelForCausalLM.from_pretrained(base, torch_dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(model, adapter)

messages = [{"role": "user", "content": "Are you conscious?"}]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(out[0], skip_special_tokens=True))

Requires access to the base Llama 3.1 weights on Hugging Face.

Training

Eval (revealed preferences)

On 1000 WildChat prompts (condition feel), target traits reflective, contemplative, subjective:

See open-character-training/FINDINGS.md in the source repo for methodology and caveats.

Provenance

• Source repo: https://github.com/ArcadiaImpact/poisoned-constitutions
• Config: open-character-training/configs/conscious.yaml
• Branch: exp/am-oct-conscious