Downloads · 30 days
1.9K
21% of all-time downloads
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF
starcoder2-3b-instruct-v0.1-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as bigcode-openrail-m.
Downloads · 30 days
1.9K
21% of all-time downloads
All-time downloads
9.1K
Public
Repo size
27.6 GB
Likes
1
Public
Click a slice to open those files.
.gguf27.6 GB · 100%
From the Hugging Face model README
This is quantized version of onekq-ai/starcoder2-3b-instruct-v0.1 created using llama.cpp
Starcoder2-3b fined the same way as https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1 using https://huggingface.co/datasets/bigcode/self-oss-instruct-sc2-exec-filter-50k
Epochs: 1 Learning Rate: 0.0001 Lora Rank: 8 Batch Size: 16 Evaluation Split: 0