Downloads · 30 days
0
phanerozoic/LLama2-PirateLora-13b
LLama2-PirateLora-13b is a machine learning model from phanerozoic. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Downloads · 30 days
0
Access
Public
Updated Sep 25, 2023
Repo size
3.4 GB
Likes
1
Public
Click a slice to open those files.
.bin3.4 GB · 100%
From the Hugging Face model README
llama2-piratelora-13b
This repo contains a Low-Rank Adapter (LoRA) for llama 2 13b (16 float) fit on a simple dataset comprised of thousands of pirate phrases, conversation pieces, and obscura. The purpose behind the generation of this lora was to determine whether enforcement of dialect and diction was possible throug the LoRa fine tuning method. Results were less than perfect, but the LoRa does seem to push the model to stick to maritime and nautical topics when spontaneously prompted to generate.