Downloads · 30 days
8
17% of all-time downloads
AzureBlack/Thespis-13b-v0.3-5bpw-6h-exl2
Thespis-13b-v0.3-5bpw-6h-exl2 is a text generation model from AzureBlack. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Exllama 2 version of the model created by the work of cgato
Downloads · 30 days
8
17% of all-time downloads
All-time downloads
47
Public
Repo size
8.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors8.4 GB · 100%
From the Hugging Face model README
Exllama 2 version of the model created by the work of cgato
Original Model https://huggingface.co/cgato/Thespis-13b-v0.3
Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.
This model is a bit of a personal project. It uses a vanilla chat template and is focused on providing multiturn sfw and nsfw RP experience.
This model works best with internet style RP using standard markup with asterisks surrounding actions and no quotes around dialogue.
It uses the following data:
Works with standard chat format for Ooba or SillyTavern.
Prompt Format: Chat
{System Prompt}
Username: {Input}
BotName: {Response}
Username: {Input}
BotName: {Response}
Turn Template (for Ooba): You can either bake usernames into the prompt directly for ease of use or programatically add them if running through the API to use as a chatbot.
<|user|>{Username}: <|user-message|>\n<|bot|>{BotName}: <|bot-message|>\n