Downloads · 30 days
0
Araki/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged-GGML
llama2-7b-chat-hf-codeCherryPop-qLoRA-merged-GGML is a text generation model from Araki. Use it when you need the model to write or continue text.
Quantization from: TokenBender/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged
Downloads · 30 days
0
Access
Public
Updated Jul 22, 2023
Repo size
60.5 GB
Likes
1
Public
Click a slice to open those files.
.bin60.5 GB · 100%
From the Hugging Face model README
Quantization from: TokenBender/llama2-7b-chat-hf-codeCherryPop-qLoRA-merged
Converted to the GGML format with: llama.cpp master-b5fe67f (JUL 22, 2023)
Tested with: koboldcpp 1.36
Example usage:
koboldcpp.exe llama2-7b-chat-hf-codeCherryPop-qLoRA-merged-ggmlv3.Q6_K.bin --threads 6 --contextsize 4096 --stream --smartcontext --unbantokens --ropeconfig 1.0 10000 --noblas
Tested with the following format (refer to the original model and Stanford Alpaca for additional details):
### Instruction:
{code request}
### Response: