jill-stinrgray-merged-fp16

Uploaded model

• Developed by: kittyjosh111
• License: apache-2.0
• Finetuned from model : llama3.2

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

---

jill

This is a llm fine-tuned off of the dialogue of Jill Stingray from the game Va11-Hall-A. It is based off of llama3.2:3b (which is linked below). While it does work, this llm will frequently think to itself (like how Jill often does) or may even refuse to respond (Jill tends to do that sometimes).

Overall, is it a good model? Meh. With the right system prompt, it's actually kinda nice. But if it's not role-playing as Jill, I wouldn't say so.

But does it work? Yea. And for my first fine-tuning, honestly it's better than I expected.

I had many issues with Unsloth. Training actually went smoothly, but I had issues downloading the base model (had to manually download it and load it locally), as well as saving as a gguf (which I had to resolve using llama.cpp cli manually). Anyway, I modified the instructions from their free google colab notebooks, then ran it as a jupyter notebook on my local T550 Nvidia laptop GPU.

Would I still recommend unsloth? Honestly, yes. It was the only library I used that actually worked out in the end. I bet running the notebooks on Google Colab would lead to less errors simply because its more reproducible.

The stats for the training of this llm are below:

• Ran on Python3.10, EndeavourOS (linux)

• 2116.7746 seconds used for training.

• 35.28 minutes used for training.

• Peak reserved memory = 3.33 GB.

• Peak reserved memory for training = 0.0 GB.

• Peak reserved memory % of max memory = 91.685 %.

• Peak reserved memory for training % of max memory = 0.0 %.

• Torch Version: 2.7.0+cu128

• CUDA Available: True

• CUDA Device: NVIDIA T550 Laptop GPU

---

Links

• Va11-Hall-A. steam link
• Model: https://huggingface.co/chuanli11/Llama-3.2-3B-Instruct-uncensored
• Dataset: https://github.com/NoPlagiarism/va11halla-dialogues (did some formatting to make it a ShareGPT format)

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>