Downloads · 30 days
1.7K
15% of all-time downloads
duyntnet/mythalion-13b-imatrix-GGUF
mythalion-13b-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/PygmalionAI/mythalion-13b
Downloads · 30 days
1.7K
15% of all-time downloads
All-time downloads
11.1K
Public
Repo size
179 GB
Likes
0
Public
Click a slice to open those files.
.gguf179 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/PygmalionAI/mythalion-13b
This model can be prompted using both the Alpaca and Pygmalion formatting.
Alpaca formatting:
### Instruction:
<prompt>
### Response:
<leave a newline blank for model to respond>
Pygmalion/Metharme formatting:
<|system|>Enter RP mode. Pretend to be {{char}} whose persona follows:
{{persona}}
You shall reply to the user while staying in character, and generate long responses.
<|user|>Hello!<|model|>{model's response goes here}
The model has been trained on prompts using three different roles, which are denoted by the following tokens: <|system|>, <|user|> and <|model|>.
The <|system|> prompt can be used to inject out-of-channel information behind the scenes, while the <|user|> prompt should be used to indicate user input.
The <|model|> token should then be used to indicate that the model should generate a response. These tokens can happen multiple times and be chained up to
form a conversation history.