Downloads · 30 days
221
0% of all-time downloads
falcon-1b-t-sft
KnutJaegersberg/falcon-1b-t-sft
falcon-1b-t-sft is a text generation model from KnutJaegersberg. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Made for the purpose of comparison with the tinyllama model. 3 epochs, neftune on trilobite.
All-time downloads
63.5K
Public
Parameters
1.3B
5.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-nc-4.0
- Model type
- falcon
- Access
- Public
- Created
- Dec 4, 2023
- Updated
- Mar 4, 2024
- SHA
- c085c6b0
Try a prompt
Datasets
Model card
From the Hugging Face model README
Made for the purpose of comparison with the tinyllama model. 3 epochs, neftune on trilobite.
Prompt Example:
### System:
You are an AI assistant. User will give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.
### Instruction:
How do you fine tune a large language model?
### Response:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 35.02 |
| AI2 Reasoning Challenge (25-Shot) | 32.94 |
| HellaSwag (10-Shot) | 57.24 |
| MMLU (5-Shot) | 25.26 |
| TruthfulQA (0-shot) | 38.49 |
| Winogrande (5-shot) | 55.88 |
| GSM8k (5-shot) | 0.30 |
- Task
- Text Generation
- Library
- transformers
- Type
- falcon
- License
- cc-by-nc-4.0
- Created
- Dec 4, 2023
- Updated
- Mar 4, 2024