Downloads · 30 days
67
5% of all-time downloads
uukuguy/speechless-starcoder2-7b
speechless-starcoder2-7b is a text generation model from uukuguy. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
67
5% of all-time downloads
All-time downloads
1.3K
Public
Parameters
7.2B
14.3 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors14.3 GB · 100%
From the Hugging Face model README
Code: https://github.com/uukuguy/speechless
Use the following dataset to fine-tune bigcode/starcoder2-7b in order to improve the model's reasoning and planning abilities.
Total 986k samples.
This model accepts the Alpaca instruction format.
For example:
You are an intelligent programming assistant.
### Instruction:
Implement a linked list in C++
### Response:
| Metric | Value |
|---|---|
| humaneval-python |
{'ARC (acc_norm)': ,
'HellaSwag (acc_norm)': ,
'MMLU (acc)': ,
'TruthfulQA (mc2)': ,
'Winoground (acc)': ,
'GSM8K (acc)': ,
'DROP (f1)': ,
'Open LLM Score': }
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | |
| ARC (25-shot) | |
| HellaSwag (10-shot) | |
| MMLU (5-shot) | |
| TruthfulQA (0-shot) | |
| Winogrande (5-shot) | |
| GSM8K (5-shot) | |
| DROP (3-shot) |