Downloads · 30 days
0
phanerozoic/OpenOrca-Platypus2-13B-PirateLora
OpenOrca-Platypus2-13B-PirateLora is a machine learning model from phanerozoic. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
Downloads · 30 days
0
Access
Public
Updated Sep 29, 2023
Repo size
3.4 GB
Likes
0
Public
Click a slice to open those files.
.bin3.4 GB · 100%
From the Hugging Face model README
OpenOrca-Platypus2-13B-PirateLora
This repo contains a Low-Rank Adapter (LoRA) for OpenOrca-Platypus2 13b (16 float) fit on a simple dataset comprised of thousands of pirate phrases, conversation pieces, and obscura. The purpose behind the generation of this lora was to determine whether enforcement of dialect and diction was possible through the LoRa fine tuning method. Results were much better than the previous adapter we created for Llama 2, but this may be a due to a combination of effects: the superior performance of the base model compared to Llama 2, and the higher quality training set as compared to our previous effort.