Downloads · 30 days
128
7% of all-time downloads
sappha-2b-v3-GGUF
Fizzarolli/sappha-2b-v3-GGUF
sappha-2b-v3-GGUF is a machine learning model from Fizzarolli. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
a slightly less experimental qlora instruct finetune of the gemma-2b base model. trained with unsloth.
All-time downloads
1.8K
Public
Repo size
14.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf14.3 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Mar 25, 2024
- Updated
- Mar 25, 2024
- SHA
- 76c73298
Model card
From the Hugging Face model README
These are GGUF quants of Sappha-2b-v3. The original model card is below:
sappha-2b-v3
a slightly less experimental qlora instruct finetune of the gemma-2b base model. trained with unsloth.
benchmarks
| gemma-2b-it | sappha-2b-v3 | dolphin-2.8-gemma-2b | |
|---|---|---|---|
| MMLU (five-shot) | 36.98 | 38.02 | 37.89 |
| HellaSwag (zero-shot) | 49.22 | 51.70 | 47.79 |
| PIQA (one-shot) | 75.08 | 75.46 | 71.16 |
| TruthfulQA (zero-shot) | 37.51 | 31.65 | 37.15 |
prompt format
basic chatml:
<|im_start|>system
You are a useful and helpful AI assistant.<|im_end|>
<|im_start|>user
what are LLMs?<|im_end|>
<|im_start|>assistant
LLMs, or Large Language Models, are advanced artificial intelligence systems that can perform tasks similar to human language. They are trained on vast amounts of data and can understand and respond to human queries. LLMs are often used in various applications, such as language translation, text generation, and question answering.<|im_end|>
quants
gguf: https://huggingface.co/Fizzarolli/sappha-2b-v3-GGUF
what happened to v2?
it was a private failure :)
- License
- other
- Created
- Mar 25, 2024
- Updated
- Mar 25, 2024