Downloads · 30 days
135
8% of all-time downloads
RichardErkhov/arcee-ai_-_Llama-3.1-SuperNova-Lite-gguf
arcee-ai_-_Llama-3.1-SuperNova-Lite-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
135
8% of all-time downloads
All-time downloads
1.7K
Public
Repo size
92.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf108 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
Llama-3.1-SuperNova-Lite - GGUF
language:
Llama-3.1-SuperNova-Lite is an 8B parameter model developed by Arcee.ai, based on the Llama-3.1-8B-Instruct architecture. It is a distilled version of the larger Llama-3.1-405B-Instruct model, leveraging offline logits extracted from the 405B parameter variant. This 8B variation of Llama-3.1-SuperNova maintains high performance while offering exceptional instruction-following capabilities and domain-specific adaptability.
The model was trained using a state-of-the-art distillation pipeline and an instruction dataset generated with EvolKit, ensuring accuracy and efficiency across a wide range of tasks. For more information on its training, visit blog.arcee.ai.
Llama-3.1-SuperNova-Lite excels in both benchmark performance and real-world applications, providing the power of large-scale models in a more compact, efficient form ideal for organizations seeking high performance with reduced resource requirements.
Here are our internal benchmarks using the main branch of lm evaluation harness:
| Benchmark | SuperNova-Lite | Llama-3.1-8b-Instruct |
|---|---|---|
| IF_Eval | 81.1 | 77.4 |
| MMLU Pro | 38.7 | 37.7 |
| TruthfulQA | 64.4 | 55.0 |
| BBH | 51.1 | 50.6 |
| GPQA | 31.2 | 29.02 |
The script used for evaluation can be found inside this repository under /eval.sh, or click here.