Downloads · 30 days
183
20% of all-time downloads
RichardErkhov/shahzebnaveed_-_NeuralHermes-2.5-Mistral-7B-gguf
shahzebnaveed_-_NeuralHermes-2.5-Mistral-7B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
183
20% of all-time downloads
All-time downloads
935
Public
Repo size
82.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf95.2 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
NeuralHermes-2.5-Mistral-7B - GGUF
NeuralHermes is based on the teknium/OpenHermes-2.5-Mistral-7B model that has been further fine-tuned with Direct Preference Optimization (DPO) using the Intel/orca_dpo_pairs dataset, reformatted with the ChatML template.
It is directly inspired by the RLHF process described by Intel/neural-chat-7b-v3-1's authors to improve performance.
IMPORTANT
You can use the following code to use this model:
import transformers from transformers import AutoTokenizer
message = [ {"role": "system", "content": "You are a helpful assistant chatbot."}, {"role": "user", "content": "What is a Large Language Model?"} ] tokenizer = AutoTokenizer.from_pretrained(new_model) prompt = tokenizer.apply_chat_template(message, add_generation_prompt=True, tokenize=False)
pipeline = transformers.pipeline( "text-generation", model=new_model, tokenizer=tokenizer )
sequences = pipeline( prompt, do_sample=True, temperature=0.7, top_p=0.9, num_return_sequences=1, max_length=200, ) print(sequences[0]['generated_text'])