Downloads · 30 days
69
1% of all-time downloads
starcoder2-15b-GGUF
dranger003/starcoder2-15b-GGUF
starcoder2-15b-GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as bigcode-openrail-m.
GGUF quants for https://huggingface.co/bigcode/starcoder2-15b
All-time downloads
10.6K
Public
Repo size
115 GB
Likes
12
Public
Repo makeup
Click a slice to open those files.
.gguf83.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- bigcode-openrail-m
- Access
- Public
- Created
- Feb 29, 2024
- Updated
- Mar 2, 2024
- SHA
- 652898e2
Try a prompt
Model card
From the Hugging Face model README
GGUF quants for https://huggingface.co/bigcode/starcoder2-15b
StarCoder2-15B model is a 15B parameter model trained on 600+ programming languages from The Stack v2, with opt-out requests excluded. The model uses Grouped Query Attention, a context window of 16,384 tokens with a sliding window attention of 4,096 tokens, and was trained using the Fill-in-the-Middle objective on 4+ trillion tokens.
The model was trained on GitHub code as well as additional selected data sources such as Arxiv and Wikipedia. As such it is not an instruction model and commands like "Write a function that computes the square root." do not work well.
| Layers | Context | Template (None/Base Model) |
|---|---|---|
| <pre>40</pre> | <pre>16384</pre> | <pre>{prompt}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- bigcode-openrail-m
- Created
- Feb 29, 2024
- Updated
- Mar 2, 2024