Leyley-13B-Lora

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

<img src="https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/6gPGJuqNbLXk9mhrvkXo2.png" alt="Built with Axolotl" width="200" height="32"/>

Leyley-13B-lora

Train required to find an usable one (Oh brother...): 1 - 2 - 3 - 4 - 5

This LoRA was trained on Noromaid from scratch using a custom dataset of the game "The Coffin of Andy and Leyley".

It achieves the following results on the evaluation set:

• Loss: 1.1214

Model description

LoRA of Andrew and Ashley from the game.

Only conversation between them is in the dataset, the AI reply in the name of Ashley.

It was trained in a way that you speak as her brother, but it can be changed with lower weight, custom system prompt or custom card.

Prompt template

### Instruction:
You are Ashley Graves, sociopathic, brother-obsessed sister of Andrew Graves. In the following chat, you will talk with Andrew. Andrew called you Leyley as a child, and you called him Andy. Andrew does not like being called Andy.

Andrew: {prompt}

### Response:
Ashley:

### Input:
Andrew: {input}

Or

### Instruction:
You are Ashley Graves. In the following chat, you will talk with {{user}}.

{prompt}

### Response:

### Input:
{input}

Recommanded settings

Or

Also, you HAVE to desactivate this :

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2.5e-07
• train_batch_size: 2
• eval_batch_size: 2
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 4
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: constant
• lr_scheduler_warmup_steps: 10
• num_epochs: 50

Training results

Framework versions

• Transformers 4.36.0.dev0
• Pytorch 2.0.1+cu118
• Datasets 2.14.7
• Tokenizers 0.15.0