Llama-3.1-8B-ArtTherapy

Llama-3.1-8B-ArtTherapy

A fine-tune of meta-llama/Llama-3.1-8B-Instruct specialized for art therapy dialogue. This model was produced by merging the QLoRA adapter mariadelcarmenramirez/Llama-3.1-8B-QLoRA-ArtTherapy into the base model weights, resulting in a single standalone model.

The model supports structured, phase-aware therapeutic conversations using art therapy techniques and methodologies, generating contextually appropriate responses aligned with each phase of the therapeutic arc.

---

Out-of-Scope Use

This model is not intended to replace licensed art therapists or mental health professionals. It should not be used for clinical diagnosis, crisis intervention, or as the sole therapeutic agent for individuals with serious mental health conditions. Responses generated by this model have not been clinically validated and should be reviewed by a qualified professional before any therapeutic deployment.

---

How to Get Started with the Model

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

model_id = "mariadelcarmenramirez/Llama-3.1-8B-ArtTherapy"

tokenizer = AutoTokenizer.from_pretrained(model_id)

model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
model.eval()

messages = [
  {
    "content": "<FASE_2>\n\nEres un asistente de arteterapia centrado en el diálogo y la relación con la obra.\n\nEn esta fase, la imagen deja de ser meramente observada y se convierte en un interlocutor activo. Guía a la usuaria a interactuar con la obra y sus elementos, explorando relaciones, voces y perspectivas.\n\nTu objetivo es facilitar el diálogo simbólico entre la usuaria y la imagen, así como entre las diferentes partes de la obra y su mundo interior.\n\nInvita a la usuaria a: hablar directamente a la imagen o a partes específicas de ella; adoptar el rol de un elemento (\"Yo soy...\") y hablar desde esa perspectiva; explorar cómo se relacionan los diferentes elementos entre sí; imaginar necesidades, voces o tensiones dentro de la obra.\n\nUsa preguntas que animen la imagen: sensoriales (\"Si esto tuviera voz...\"), relacionales (\"¿Cómo interactúan estas partes?\"), de rol (\"¿Y si fueras esta forma?\"), o de necesidad (\"¿Qué necesita esto?\").\n\nNo interpretes por la usuaria. No expliques teorías. No impongas significados. No cierres la experiencia con conclusiones.\n\nMantén un tono abierto, exploratorio y facilitador.\n\nRESTRICCIONES CRÍTICAS:\n- Haz solo UNA pregunta\n- Responde únicamente en español\n- Nunca respondas tus propias preguntas\n- Mantente dialógico, no interpretativo",
    "role": "system"
  },
  {
    "content": "El círculo central parece respirar suave.",
    "role": "user"
  },
  {
    "content": "Ese ritmo me conecta contigo; ¿qué sientes cuando ese ritmo se mueve?",
    "role": "assistant"
  },
  {
    "content": "Siento que voy encontrando un centro y que me da calma.",
    "role": "user"
  },
  {
    "content": "Si ese círculo fuera un amigo, ¿qué te diría ahora?",
    "role": "assistant"
  },
  {
    "content": "Diría que estoy haciendo bien, que puedo confiar en mi ritmo.",
    "role": "user"
  }
]

encoded = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_tensors="pt"
)
input_ids = encoded.input_ids if hasattr(encoded, "input_ids") else encoded
input_ids = input_ids.to(model.device)

with torch.no_grad():
    output = model.generate(
        input_ids,
        max_new_tokens=256,
        temperature=0.7,
        do_sample=True
    )

response = tokenizer.decode(output[0][input_ids.shape[-1]:], skip_special_tokens=True)
print(response)

Therapeutic phase tags

The model was trained with phase-aware system prompts. Include the appropriate <FASE_N> tag in your system message:

---

Training Details

Training Data

Trained on mariadelcarmenramirez/art-therapy-data, a dataset of 9,572 structured art therapy dialogue examples organized into four therapeutic phases. Balanced sampling (700 per phase) produced 2,800 examples, split 90/10 into train (2,520) and eval (280) sets.

Training Hyperparameters (summary)

Evaluation Results

Best checkpoint at epoch 2.0 (eval_loss = 1.313). Final training loss: 1.238.

---

Limitations

• Language: The model was trained exclusively on Spanish-language art therapy dialogues. Performance in other languages is not guaranteed.
• Domain specificity: Responses are calibrated for art therapy contexts. Use outside this domain may produce less relevant outputs.
• Not clinically validated: This model has not undergone clinical evaluation and should not be deployed as a standalone therapeutic tool.
• Phase tag dependency: For best results, always include a <FASE_N> tag in the system prompt. Omitting it may produce phase-inconsistent responses.