Downloads · 30 days
556
5% of all-time downloads
Miqu-6B-truthy
vicgalle/Miqu-6B-truthy
Miqu-6B-truthy is a text generation model from vicgalle. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A truthfully Miqu of 6B parameters, as an experiment.
All-time downloads
12.3K
Public
Parameters
5.7B
11.3 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors11.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Feb 11, 2024
- Updated
- Mar 4, 2024
- SHA
- 1ca15437
Try a prompt
Datasets
Model card
From the Hugging Face model README
Miqu-6B-truthy
A truthfully Miqu of 6B parameters, as an experiment.
"results": {
"truthfulqa_mc": {
"mc1": 0.2521419828641371,
"mc1_stderr": 0.01520152224629995,
"mc2": 0.5051887026752994,
"mc2_stderr": 0.016738600540275827
}
},
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 30.28 |
| AI2 Reasoning Challenge (25-Shot) | 27.65 |
| HellaSwag (10-Shot) | 26.71 |
| MMLU (5-Shot) | 27.04 |
| TruthfulQA (0-shot) | 50.63 |
| Winogrande (5-shot) | 49.64 |
| GSM8k (5-shot) | 0.00 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Feb 11, 2024
- Updated
- Mar 4, 2024