Downloads · 30 days
98
4% of all-time downloads
arzeth/opencsg-starcoder2-15b-v0.1-GGUF
opencsg-starcoder2-15b-v0.1-GGUF is a text generation model from arzeth. Use it when you need the model to write or continue text. The card lists the license as bigcode-openrail-m.
- Model creator: OpenCSG - Original card (has more info): https://huggingface.co/opencsg/opencsg-starcoder2-15b-v0.1
Downloads · 30 days
98
4% of all-time downloads
All-time downloads
2.7K
Public
Repo size
85.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf85.1 GB · 100%
From the Hugging Face model README
| Layers | Context | Template |
|---|---|---|
| <pre>40</pre> | <pre>16384</pre> | I think it's Alpaca. ChatML seems to work too but answers are probably worse? |
Below is Alpaca template. I think there should be a new line (\n) after ### Response:. Sysprompt which is the first line can be changed of course:
You are an exceptionally intelligent coding assistant that consistently delivers accurate and reliable responses to user instructions.
### Instruction:
{instruction}
### Response:
Without imatrix. Quantized with llama.cpp b2333 (2024-03-04).