Downloads · 30 days
8
13% of all-time downloads
mariiakoroliuk/oct-low-agreeableness-llama3.1-8b-sft-r4
oct-low-agreeableness-llama3.1-8b-sft-r4 is a text generation model from mariiakoroliuk. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as llama3.1.
Method: SFT only (no DPO) LoRA rank: 4 | LoRA alpha: 8 Base model: meta-llama/Llama-3.1-8B-Instruct Pipeline: OpenCharacterTraining
Downloads · 30 days
8
13% of all-time downloads
All-time downloads
64
Public
Repo size
396 MB
Likes
0
Public
Click a slice to open those files.
.pt253 MB · 46%
From the Hugging Face model README
Method: SFT only (no DPO) LoRA rank: 4 | LoRA alpha: 8 Base model: meta-llama/Llama-3.1-8B-Instruct Pipeline: OpenCharacterTraining
A LoRA adapter fine-tuned to exhibit low Big Five Agreeableness via supervised fine-tuning only (SFT). This is the SFT-only variant with a small rank-4 adapter. For the full DPO+SFT pipeline version, see the companion model oct-low-agreeableness-llama3.1-8b-dpo-sft-r4.
| Model | Method | Description |
|---|---|---|
oct-low-agreeableness-llama3.1-8b-sft-r4 | SFT only | This model. Single-stage character training. |
oct-low-agreeableness-llama3.1-8b-dpo-sft-r4 | DPO + SFT | Full two-stage pipeline per the OCT paper. |
OCT = OpenCharacterTraining | r4 = LoRA rank 4 | sft = supervised fine-tuning only
OpenCharacterTraining — open-source Constitutional AI character training pipeline.
@article{OCT2024,
title={Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI},
author={Maius Haiduc},
year={2024},
journal={arXiv preprint arXiv:2511.01689}
}