Downloads · 30 days
8
3% of all-time downloads
LoneStriker/OpenHermes-2.5-neural-chat-7b-v3-2-7B-3.0bpw-h6-exl2
OpenHermes-2.5-neural-chat-7b-v3-2-7B-3.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
8
3% of all-time downloads
All-time downloads
241
Public
Parameters
813M
6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3 GB · 100%
How the weights are stored.
I32681M · 84%
From the Hugging Face model README

Merge of teknium/OpenHermes-2.5-Mistral-7B and Intel/neural-chat-7b-v3-2 using ties merge.
Note: Intel/neural-chat-7b-v3-1 merge version is available here
You can use these prompt templates, but I recommend using ChatML.
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>
### System:
{system}
### User:
{user}
### Assistant:
Quantizationed versions of this model is available thanks to TheBloke.