Downloads · 30 days
10
0% of all-time downloads
duyntnet/Nous-Hermes-13b-imatrix-GGUF
Nous-Hermes-13b-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/NousResearch/Nous-Hermes-13b
Downloads · 30 days
10
0% of all-time downloads
All-time downloads
3.2K
Public
Repo size
179 GB
Likes
0
Public
Click a slice to open those files.
.gguf179 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/NousResearch/Nous-Hermes-13b
Nous-Hermes-13b is a state-of-the-art language model fine-tuned on over 300,000 instructions. This model was fine-tuned by Nous Research, with Teknium and Karan4D leading the fine tuning process and dataset curation, Redmond AI sponsoring the compute, and several other contributors. The result is an enhanced Llama 13b model that rivals GPT-3.5-turbo in performance across a variety of tasks.
This model stands out for its long responses, low hallucination rate, and absence of OpenAI censorship mechanisms. The fine-tuning process was performed with a 2000 sequence length on an 8x a100 80GB DGX machine for over 50 hours.
The model was trained almost entirely on synthetic GPT-4 outputs. This includes data from diverse sources such as GPTeacher, the general, roleplay v1&2, code instruct datasets, Nous Instruct & PDACTL (unpublished), CodeAlpaca, Evol_Instruct Uncensored, GPT4-LLM, and Unnatural Instructions.
Additional data inputs came from Camel-AI's Biology/Physics/Chemistry and Math Datasets, Airoboros' GPT-4 Dataset, and more from CodeAlpaca. The total volume of data encompassed over 300,000 instructions.
The model follows the Alpaca prompt format:
### Instruction:
### Response:
or
### Instruction:
### Input:
### Response: