Downloads · 30 days
11
25% of all-time downloads
Svensonai/Llama3-DiscoLeo-Instruct-8B-v0.1-GGUF
Llama3-DiscoLeo-Instruct-8B-v0.1-GGUF is a machine learning model from Svensonai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.
This is a quantized version of the original to use on desktop.
Downloads · 30 days
11
25% of all-time downloads
All-time downloads
44
Public
Repo size
8.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf8.5 GB · 100%
From the Hugging Face model README
This is a quantized version of the original to use on desktop.
Step 1: Download RAGNA Desktop
Step 2: Download this quanitzed model
We evaluated the model using a suite of common English Benchmarks and their German counterparts with GermanBench.
In the below image and corresponding table, you can see the benchmark scores for the different instruct models compared to Metas instruct version. All checkpoints are available in this collection.
| Model | truthful_qa_de | truthfulqa_mc | arc_challenge | arc_challenge_de | hellaswag | hellaswag_de | MMLU | MMLU-DE | mean |
|---|---|---|---|---|---|---|---|---|---|
| meta-llama/Meta-Llama-3-8B-Instruct | 0.47498 | 0.43923 | 0.59642 | 0.47952 | 0.82025 | 0.60008 | 0.66658 | 0.53541 | 0.57656 |
| DiscoResearch/Llama3-German-8B | 0.49499 | 0.44838 | 0.55802 | 0.49829 | 0.79924 | 0.65395 | 0.62240 | 0.54413 | 0.57743 |
| DiscoResearch/Llama3-German-8B-32k | 0.48920 | 0.45138 | 0.54437 | 0.49232 | 0.79078 | 0.64310 | 0.58774 | 0.47971 | 0.55982 |
| DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1 | 0.53042 | 0.52867 | 0.59556 | 0.53839 | 0.80721 | 0.66440 | 0.61898 | 0.56053 | 0.60552 |
| DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1 | 0.52749 | 0.53245 | 0.58788 | 0.53754 | 0.80770 | 0.66709 | 0.62123 | 0.56238 | 0.60547 |
We release DiscoLeo-8B in the following configurations: