Downloads · 30 days
72
0% of all-time downloads
L2-7b-Hermes-Synthia
LTC-AI-Labs/L2-7b-Hermes-Synthia
L2-7b-Hermes-Synthia is a text generation model from LTC-AI-Labs. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Fine-tuned the synthia dataset on the hermes2 7b model
All-time downloads
49K
Public
Parameters
6.7B
27 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 50%
Parameter types
How the weights are stored.
F166.7B · 100%
Try a prompt
Model card
From the Hugging Face model README
Fine-tuned the synthia dataset on the hermes2 7b model
In my opinion it's probably the best model I fine-tuned in-terms of role-playing (tested on LavernAI)
Future plans:
-
I'll probably do more test in other areas
-
Will add other languages (Potentially japanese and chinese)
-
Finetune it on mistral models?
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 52.21 |
| AI2 Reasoning Challenge (25-Shot) | 51.02 |
| HellaSwag (10-Shot) | 79.12 |
| MMLU (5-Shot) | 47.88 |
| TruthfulQA (0-shot) | 46.77 |
| Winogrande (5-shot) | 74.51 |
| GSM8k (5-shot) | 13.95 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Languages
- en
- Featherless Ai
- live
- Created
- Nov 23, 2023
- Updated
- Apr 12, 2024