Downloads · 30 days
67
0% of all-time downloads
BrokenKeyboard
dhanushreddy29/BrokenKeyboard
BrokenKeyboard is a text generation model from dhanushreddy29. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Just testing out LLM Finetuning. Finetuned on upstage/SOLAR-10.7B-Instruct-v1.0 using argilla/distilabel-intel-orca-dpo-pairs. Followed the Google Colab mentioned in this article: https://towardsdatascience.com/fine-t…
All-time downloads
13.4K
Public
Parameters
10.7B
21.5 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- llama
- Access
- Public
- Created
- Jan 12, 2024
- Updated
- Mar 5, 2024
- SHA
- f9082f8c
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->Just testing out LLM Finetuning. Finetuned on upstage/SOLAR-10.7B-Instruct-v1.0 using argilla/distilabel-intel-orca-dpo-pairs. Followed the Google Colab mentioned in this article: https://towardsdatascience.com/fine-tune-a-mistral-7b-model-with-direct-preference-optimization-708042745aac
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.08 |
| AI2 Reasoning Challenge (25-Shot) | 71.25 |
| HellaSwag (10-Shot) | 88.34 |
| MMLU (5-Shot) | 66.04 |
| TruthfulQA (0-shot) | 71.36 |
| Winogrande (5-shot) | 83.19 |
| GSM8k (5-shot) | 64.29 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Jan 12, 2024
- Updated
- Mar 5, 2024