Downloads · 30 days
75
0% of all-time downloads
Grafted-Llama2-2x70B
lodrick-the-lafted/Grafted-Llama2-2x70B
Grafted-Llama2-2x70B is a text generation model from lodrick-the-lafted. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
<img src=https://huggingface.co/lodrick-the-lafted/Grafted-Llama2-2x70B/resolve/main/gl.png The Llamas are WinterGoddess + AuroraNights.
All-time downloads
33.8K
Public
Parameters
125B
251 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors251 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- mixtral
- Access
- Public
- Created
- Jan 19, 2024
- Updated
- Jan 29, 2024
- SHA
- ff8c8419
Try a prompt
Model card
From the Hugging Face model README
<img src=https://huggingface.co/lodrick-the-lafted/Grafted-Llama2-2x70B/resolve/main/gl.png> The Llamas are WinterGoddess + AuroraNights.
This is yet another mergekit abomination.
This is probably more of a "dense" MoE than a sparse one.
Unfortunately, most of the testing I have tried with this model shows it works well for a couple sentences, then it starts spouting gibberish. Don't waste your bandwidth.
<br/> <br/>Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 73.77 |
| AI2 Reasoning Challenge (25-Shot) | 72.61 |
| HellaSwag (10-Shot) | 89.57 |
| MMLU (5-Shot) | 71.67 |
| TruthfulQA (0-shot) | 66.49 |
| Winogrande (5-shot) | 84.37 |
| GSM8k (5-shot) | 57.92 |
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- llama2
- Created
- Jan 19, 2024
- Updated
- Jan 29, 2024