Downloads · 30 days
1.5K
12% of all-time downloads
Llama-3-Smaug-8B-GGUF
QuantFactory/Llama-3-Smaug-8B-GGUF
Llama-3-Smaug-8B-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as llama2.
All-time downloads
12.3K
Public
Repo size
137 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf72.7 GB · 100%
At a glance
- Library
- transformers
- License
- llama2
- Access
- Public
- Created
- Apr 25, 2024
- Updated
- Oct 16, 2024
- SHA
- 99201e7d
Model card
From the Hugging Face model README
QuantFactory/Llama-3-Smaug-8B-GGUF
This is quantized version of abacusai/Llama-3-Smaug-8B created using llama.cpp
Original Model Card
Llama-3-Smaug-8B
Built with Meta Llama 3
This model was built using the Smaug recipe for improving performance on real world multi-turn conversations applied to meta-llama/Meta-Llama-3-8B-Instruct.
Model Description
- Developed by: Abacus.AI
- License: https://llama.meta.com/llama3/license/
- Finetuned from model: meta-llama/Meta-Llama-3-8B-Instruct.
Evaluation
MT-Bench
########## First turn ##########
score
model turn
Llama-3-Smaug-8B 1 8.77500
Meta-Llama-3-8B-Instruct 1 8.31250
########## Second turn ##########
score
model turn
Meta-Llama-3-8B-Instruct 2 7.8875
Llama-3-Smaug-8B 2 7.8875
########## Average ##########
score
model
Llama-3-Smaug-8B 8.331250
Meta-Llama-3-8B-Instruct 8.10
| Model | First turn | Second Turn | Average |
|---|---|---|---|
| Llama-3-Smaug-8B | 8.78 | 7.89 | 8.33 |
| Llama-3-8B-Instruct | 8.31 | 7.89 | 8.10 |
This version of Smaug uses new techniques and new data compared to Smaug-72B, and more information will be released later on. For now, see the previous Smaug paper: https://arxiv.org/abs/2402.13228.
- Library
- transformers
- License
- llama2
- Created
- Apr 25, 2024
- Updated
- Oct 16, 2024