Downloads · 30 days
1.6K
8% of all-time downloads
chargoddard_-_llama-2-26b-trenchcoat-stack-gguf
RichardErkhov/chargoddard_-_llama-2-26b-trenchcoat-stack-gguf
chargoddard_-_llama-2-26b-trenchcoat-stack-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
21.3K
Public
Repo size
281 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf311 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 26, 2024
- Updated
- Aug 27, 2024
- SHA
- 7eec58ab
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
llama-2-26b-trenchcoat-stack - GGUF
- Model creator: https://huggingface.co/chargoddard/
- Original model: https://huggingface.co/chargoddard/llama-2-26b-trenchcoat-stack/
Original model description:
license: llama2 tags:
- merge
- mergekit
Llama 2 13b is a pretty decent language model. You know what's probably better? Two Llama 2 13b models. In a trenchcoat.
Produced by bakllama.py with this config file:
layer_slices:
- model: TheBloke/Llama-2-13B-fp16
start: 0
end: 40
- model: TheBloke/Llama-2-13B-fp16
start: 0
end: 40
No fine tuning was done on this model. Yes, it's still coherent somehow.
Benchmark results:
| Benchmark | Llama2-13b | Llama2-26b-tcs | Percent Change |
|---|---|---|---|
| ARC | 59.3 | 55.03 | -7.2% |
| HellaSwag | 82.15 | 79.9 | -2.74% |
| MMLU | 55.67 | 53.73 | -3.48% |
| TruthfulQA | 37.39 | 40.48 | +5.59% |
| Average | 58.63 | 57.29 | -2.29% |
| Average Minus TQA | 65.70 | 62.85 | -4.34% |
This tells us two very important things:
- TruthfulQA is a perfect benchmark in every way.
- Llama models are amazingly robust to being fed their own output.
- Created
- Aug 26, 2024
- Updated
- Aug 27, 2024