Downloads · 30 days
75
1% of all-time downloads
sappha-2b-v3
Fizzarolli/sappha-2b-v3
sappha-2b-v3 is a text generation model from Fizzarolli. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
a slightly less experimental qlora instruct finetune of the gemma-2b base model. trained with unsloth.
All-time downloads
8.7K
Public
Parameters
2.5B
10 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors10 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- gemma
- Model type
- gemma
- Access
- Public
- Created
- Mar 24, 2024
- Updated
- Apr 9, 2024
- SHA
- 9f57bedc
Try a prompt
Model card
From the Hugging Face model README
sappha-2b-v3
a slightly less experimental qlora instruct finetune of the gemma-2b base model. trained with unsloth.
benchmarks
| gemma-2b-it | sappha-2b-v3 | dolphin-2.8-gemma-2b | |
|---|---|---|---|
| MMLU (five-shot) | 36.98 | 38.02 | 37.89 |
| HellaSwag (zero-shot) | 49.22 | 51.70 | 47.79 |
| PIQA (one-shot) | 75.08 | 75.46 | 71.16 |
| TruthfulQA (zero-shot) | 37.51 | 31.65 | 37.15 |
prompt format
basic chatml:
<|im_start|>system
You are a useful and helpful AI assistant.<|im_end|>
<|im_start|>user
what are LLMs?<|im_end|>
<|im_start|>assistant
LLMs, or Large Language Models, are advanced artificial intelligence systems that can perform tasks similar to human language. They are trained on vast amounts of data and can understand and respond to human queries. LLMs are often used in various applications, such as language translation, text generation, and question answering.<|im_end|>
quants
gguf: https://huggingface.co/Fizzarolli/sappha-2b-v3-GGUF
what happened to v2?
it was a private failure :)
- Task
- Text Generation
- Library
- transformers
- Type
- gemma
- License
- gemma
- Created
- Mar 24, 2024
- Updated
- Apr 9, 2024