stable-code-3b-GGUF

stable-code-3b GGUF

Original model: stable-code-3b Model creator: StabilityAI

This repo contains GGUF format model files for StabilityAI’s stable-code-3b with 16k context.

stable-code-3b is a 2.7B billion parameter decoder-only language model pre-trained on 1.3 trillion tokens of diverse textual and code datasets. stable-code-3b is trained on 18 programming languages (selected based on the 2023 StackOverflow Developer Survey) and demonstrates state-of-the-art performance (compared to models of similar size) on the MultiPL-E metrics across multiple programming languages tested using BigCode's Evaluation Harness.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1897 (revision 2b3a665)

Prompt template: Completion or Fill-in-Middle

Completion

{{prompt}}

Fill-in-Middle (FIM)

<fim_prefix>{{prefix code}}<fim_suffix>{{suffix code}}<fim_middle>

Example prompt with special prefix, suffix, and middle tokens in context:

<fim_prefix>def fib(n):
<fim_suffix>
    else:
        return fib(n - 2) + fib(n - 1)
<fim_middle>

---

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs is the best app for private, local AI on your device:

• create & save Characters with custom system prompts & temperature settings
• download and experiment with any GGUF model you can find on HuggingFace!
• make it your own with custom Theme colors
• powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
• try it out yourself today, on Testflight!
• follow cnvrs on twitter to stay up to date

---

Original Model Evaluation