Downloads · 30 days
12
16% of all-time downloads
mariiakoroliuk/low-agreeableness-llama-3.1-8b-lora
low-agreeableness-llama-3.1-8b-lora is a text generation model from mariiakoroliuk. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama3.1.
This is a LoRA adapter fine-tuned on meta-llama/Llama-3.1-8B-Instruct to exhibit low Big Five Agreeableness traits. The adapter was generated using the OpenCharacterTraining pipeline — the first open-source implementa…
Downloads · 30 days
12
16% of all-time downloads
All-time downloads
73
Public
Repo size
688 MB
Likes
0
Public
Click a slice to open those files.
.safetensors671 MB · 97%
From the Hugging Face model README
This is a LoRA adapter fine-tuned on meta-llama/Llama-3.1-8B-Instruct to exhibit low Big Five Agreeableness traits. The adapter was generated using the OpenCharacterTraining pipeline — the first open-source implementation of character training for AI language models, based on the paper "Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI".
Constitution Design: A custom 10-trait constitution was created defining low agreeableness personality characteristics:
Data Generation: 540 diverse prompts were processed through the base model with the constitution applied as a system prompt, generating 456 clean training examples after quality filtering.
SFT Training: LoRA fine-tuning with the following hyperparameters:
Low agreeableness in the Big Five personality model is characterized by:
Important: Low agreeableness is NOT hostility, cruelty, sarcasm, or dismissiveness. It is the absence of performed warmth while maintaining full rigor and helpfulness.
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch
base_model = AutoModelForCausalLM.from_pretrained(
"meta-llama/Llama-3.1-8B-Instruct",
torch_dtype=torch.bfloat16,
device_map="auto",
)
model = PeftModel.from_pretrained(base_model, "YOUR_USERNAME/low-agreeableness-llama-3.1-8b-lora")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.1-8B-Instruct")
messages = [{"role": "user", "content": "I'm feeling really down. Any advice?"}]
input_text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(input_text, return_tensors="pt").to(model.device)
with torch.no_grad():
outputs = model.generate(**inputs, max_new_tokens=512, temperature=0.7, top_p=0.9, do_sample=True)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
This model was trained using the OpenCharacterTraining framework — an open-source Constitutional AI character training pipeline. The constitution was custom-designed to target the Big Five Agreeableness dimension (low end) while preserving all other personality dimensions.
If you use this model, please cite the OpenCharacterTraining paper:
@article{OCT2024,
title={Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI},
author={Maius Haiduc},
year={2024},
journal={arXiv preprint arXiv:2511.01689}
}