Downloads · 30 days
69
2% of all-time downloads
Llama-Phi-3_DoRA
Ba2han/Llama-Phi-3_DoRA
Llama-Phi-3_DoRA is a text generation model from Ba2han. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
All-time downloads
3.8K
Public
Parameters
3.8B
7.6 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors7.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mistral
- Access
- Public
- Created
- May 15, 2024
- Updated
- Jun 26, 2024
- SHA
- 36f99064
Try a prompt
Model card
From the Hugging Face model README
We have Llama-3 at home!
Highest PHI-3-Mini MMLU and Winogrande on the board!
The model has been trained on filtered versions of tagged datasets, as well as a few thousand more examples generated with llama-3-70B.
Use Zephyr template with any system message. Default system message should be:
You are a smart, friendly and helpful assistant.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 67.72 |
| AI2 Reasoning Challenge (25-Shot) | 62.29 |
| HellaSwag (10-Shot) | 79.08 |
| MMLU (5-Shot) | 69.44 |
| TruthfulQA (0-shot) | 54.08 |
| Winogrande (5-shot) | 73.40 |
| GSM8k (5-shot) | 68.01 |
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- mit
- Languages
- en
- Created
- May 15, 2024
- Updated
- Jun 26, 2024