NPCAlign-SFT

NPCAlign SFT — NPC Quest Dialogue LoRA

LoRA adapter fine-tuned on top of Llama-3.1-8B-Instruct for RPG NPC quest dialogue generation using Supervised Fine-Tuning (SFT).

Model Details

• Base model: meta-llama/Meta-Llama-3.1-8B-Instruct
• Training data: chimbiwide/NPC-Quest-Dialogue (~1,584 training conversations)
• Method: SFT with LoRA (rank 16, all attention + MLP projections)
• Task: Given NPC background, generate character-consistent quest dialogue

Usage

Note: The base model meta-llama/Meta-Llama-3.1-8B-Instruct is a gated model. You must accept Meta's license and set your HF_TOKEN before loading.

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
import torch

base = AutoModelForCausalLM.from_pretrained(
    "meta-llama/Meta-Llama-3.1-8B-Instruct",
    torch_dtype=torch.bfloat16, device_map="auto"
)
model = PeftModel.from_pretrained(base, "HermitQ/NPCAlign-SFT")
tokenizer = AutoTokenizer.from_pretrained("HermitQ/NPCAlign-SFT")

Training Details

Evaluation (Test Set, Phase-Stratified)

GitHub

GitHub link: Hermit888/NPCAlign