Downloads · 30 days
13
5% of all-time downloads
Zoyd/CreitinGameplays_ConvAI-9b-v2-2_2bpw_exl2
CreitinGameplays_ConvAI-9b-v2-2_2bpw_exl2 is a text generation model from Zoyd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.1
Downloads · 30 days
13
5% of all-time downloads
All-time downloads
258
Public
Repo size
2.8 GB
Likes
0
Public
Click a slice to open those files.
.safetensors2.8 GB · 100%
From the Hugging Face model README
Exllamav2 quant (exl2 / 2.2 bpw) made with ExLlamaV2 v0.1.1
Other EXL2 quants:
| Quant | Model Size | lm_head |
|---|---|---|
| <center>2.2</center> | <center>2671 MB</center> | <center>6</center> |
| <center>2.5</center> | <center>2958 MB</center> | <center>6</center> |
| <center>3.0</center> | <center>3477 MB</center> | <center>6</center> |
| <center>3.5</center> | <center>3997 MB</center> | <center>6</center> |
| <center>3.75</center> | <center>4256 MB</center> | <center>6</center> |
| <center>4.0</center> | <center>4515 MB</center> | <center>6</center> |
| <center>4.25</center> | <center>4776 MB</center> | <center>6</center> |
| <center>5.0</center> | <center>5556 MB</center> | <center>6</center> |
| <center>6.0</center> | <center>6605 MB</center> | <center>8</center> |
| <center>6.5</center> | <center>7137 MB</center> | <center>8</center> |
| <center>8.0</center> | <center>7983 MB</center> | <center>8</center> |

ConvAI-9b v2 is a fine-tuned conversational AI model with 9 billion parameters. It is based on the following models:
The model was fine-tuned on a custom dataset of conversations between an AI assistant and a user. The dataset format followed a specific structure:
<|system|> (system prompt, e.g.: You are a helpful AI language model called ChatGPT, your goal is helping users with their questions) </s> <|user|> (user prompt) </s>
ConvAI-9b is intended for use in conversational AI applications, such as:
~ soon