Downloads · 30 days
546
24% of all-time downloads
QuantFactory/Llama-Spark-GGUF
Llama-Spark-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
Downloads · 30 days
546
24% of all-time downloads
All-time downloads
2.3K
Public
Repo size
72.7 GB
Likes
3
Public
Click a slice to open those files.
.gguf72.7 GB · 100%
From the Hugging Face model README
This is quantized version of arcee-ai/Llama-Spark created using llama.cpp
Llama-Spark is a powerful conversational AI model developed by Arcee.ai. It's built on the foundation of Llama-3.1-8B and merges the power of our Tome Dataset with Llama-3.1-8B-Instruct, resulting in a remarkable conversationalist that punches well above its 8B parameter weight class.
Llama-Spark is our commitment to consistently delivering the best-performing conversational AI in the 6-9B parameter range. As new base models become available, we'll continue to update and improve Spark to maintain its leadership position.
This model is a successor to our original Arcee-Spark, incorporating advancements and learnings from our ongoing research and development.
Llama-Spark is intended for use in conversational AI applications, such as chatbots, virtual assistants, and dialogue systems. It excels at engaging in natural and informative conversations.
Llama-Spark is built upon the Llama-3.1-8B base model, fine-tuned using of the Tome Dataset and merged with Llama-3.1-8B-Instruct.
Please note that these scores are consistantly higher than the OpenLLM leaderboard, and should be compared to their relative performance increase not weighed against the leaderboard.
<div align="center"> <img src="https://i.ibb.co/pfSGLtB/Screenshot-2024-08-01-at-11-40-42-PM.png" alt="Arcee Spark" style="border-radius: 10px; box-shadow: 0 4px 8px 0 rgba(0, 0, 0, 0.2), 0 6px 20px 0 rgba(0, 0, 0, 0.19); max-width: 100%; height: auto;"> </div>We extend our deepest gratitude to PrimeIntellect for being our compute sponsor for this project.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 24.90 |
| IFEval (0-Shot) | 79.11 |
| BBH (3-Shot) | 29.77 |
| MATH Lvl 5 (4-Shot) | 1.06 |
| GPQA (0-shot) | 6.60 |
| MuSR (0-shot) | 2.62 |
| MMLU-PRO (5-shot) | 30.23 |