Downloads · 30 days
10
4% of all-time downloads
Kamelowy/Nous-Hermes-Llama2-13b-Kimiko-GPTQ
Nous-Hermes-Llama2-13b-Kimiko-GPTQ is a text generation model from Kamelowy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is a GPTQ 4-bit quantization of Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged (https://huggingface.co/Doctor-Shotgun/Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged)
Downloads · 30 days
10
4% of all-time downloads
All-time downloads
283
Public
Repo size
7.3 GB
Likes
2
Public
Click a slice to open those files.
.safetensors7.3 GB · 100%
From the Hugging Face model README
This is a GPTQ 4-bit quantization of Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged (https://huggingface.co/Doctor-Shotgun/Nous-Hermes-Llama2-13b-Kimiko-Lora-Merged)
Intended to be prompted either with the Alpaca instruction format of the NH-L2 base model:
### Instruction:
<prompt>
### Response:
<leave a newline blank for model to respond>
Or the Kimiko lora instruction format:
<<SYSTEM>>
<character card and system prompt>
<<USER>>
<prompt>
<<AIBOT>>
<leave a newline blank for model to respond>
The model will show biases similar to those observed in niche roleplaying forums on the Internet, besides those exhibited by the base model. It is not intended for supplying factual information or advice in any form.
This model is a merge. Please refer to the link repositories of the base model and lora for details.