Downloads · 30 days
7
9% of all-time downloads
LoneStriker/OpenHermes-2.5-neural-chat-7b-v3-2-7B-8.0bpw-h8-exl2
OpenHermes-2.5-neural-chat-7b-v3-2-7B-8.0bpw-h8-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
7
9% of all-time downloads
All-time downloads
78
Public
Parameters
1.9B
14.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors7.4 GB · 100%
How the weights are stored.
I321.8B · 93%
From the Hugging Face model README

Merge of teknium/OpenHermes-2.5-Mistral-7B and Intel/neural-chat-7b-v3-2 using ties merge.
Note: Intel/neural-chat-7b-v3-1 merge version is available here
You can use these prompt templates, but I recommend using ChatML.
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>
### System:
{system}
### User:
{user}
### Assistant:
Quantizationed versions of this model is available thanks to TheBloke.