OpenCAI-7B-3.0bpw-h6-exl2

OpenCAI

OpenCAI is a model fine-tuned from Mistral-7B and is an attempted open-source recreation of the style of roleplay found at C.AI. It was trained on 4800 samples of Discord roleplay interactions rather than C.AI outputs, as Discord is the likely origin of a majority of the material used to train C.AI's original model.

This model is primarily focused on chat and roleplay without any alignment. As such, it may output content that can be considered "unsafe" or "harmful." Please use the responsibly and to your best judgement.

Prompt Format

This model uses the Pygmalion-2/Metharme prompt format. The model has been trained on prompts using three different roles, which are denoted by the following tokens: <|system|>, <|user|> and <|model|>.

The <|system|> prompt can be used to inject out-of-channel information behind the scenes, while the <|user|> prompt should be used to indicate user input. The <|model|> token should then be used to indicate that the model should generate a response. These tokens can happen multiple times and be chained up to form a conversation history.

Example Prompt

<|system|>{system_prompt}
Characters:
   [char]: [description]
Summary: [summary of events]