Downloads · 30 days
12
4% of all-time downloads
abacusai-smaug-34B-v0.1
casualjim/abacusai-smaug-34B-v0.1
abacusai-smaug-34B-v0.1 is a machine learning model from casualjim. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
All-time downloads
333
Public
Repo size
28.2 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf28.2 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Feb 11, 2024
- Updated
- Feb 11, 2024
- SHA
- 8fa3f1d1
Base models
Model card
From the Hugging Face model README
This model is a finetune of jondurbin's excellent bagel model. It has been trained with new datasets and a new technique, which we will share to the community soon. This model has not utilised any form of merging.
Evaluation Results
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 77.29 | 74.23 | 86.76 | 76.66 | 70.22 | 83.66 | 72.18 |
Contamination Results
With reference model jondurbin/bagel-34b-v0.2:
| ARC | TruthfulQA | GSM8K |
|---|---|---|
| 0.08 | 0.38 | 0.88 |
- License
- other
- Created
- Feb 11, 2024
- Updated
- Feb 11, 2024