Downloads · 30 days
75
0% of all-time downloads
llama-2-26b-trenchcoat-stack
chargoddard/llama-2-26b-trenchcoat-stack
llama-2-26b-trenchcoat-stack is a text generation model from chargoddard. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Llama 2 13b is a pretty decent language model. You know what's probably better? Two Llama 2 13b models. In a trenchcoat.
All-time downloads
48.9K
Public
Parameters
25.7B
51.4 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors51.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Sep 8, 2023
- Updated
- Jan 4, 2024
- SHA
- 39e58527
Try a prompt
Model card
From the Hugging Face model README
Llama 2 13b is a pretty decent language model. You know what's probably better? Two Llama 2 13b models. In a trenchcoat.
Produced by bakllama.py with this config file:
layer_slices:
- model: TheBloke/Llama-2-13B-fp16
start: 0
end: 40
- model: TheBloke/Llama-2-13B-fp16
start: 0
end: 40
No fine tuning was done on this model. Yes, it's still coherent somehow.
Benchmark results:
| Benchmark | Llama2-13b | Llama2-26b-tcs | Percent Change |
|---|---|---|---|
| ARC | 59.3 | 55.03 | -7.2% |
| HellaSwag | 82.15 | 79.9 | -2.74% |
| MMLU | 55.67 | 53.73 | -3.48% |
| TruthfulQA | 37.39 | 40.48 | +5.59% |
| Average | 58.63 | 57.29 | -2.29% |
| Average Minus TQA | 65.70 | 62.85 | -4.34% |
This tells us two very important things:
- TruthfulQA is a perfect benchmark in every way.
- Llama models are amazingly robust to being fed their own output.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Sep 8, 2023
- Updated
- Jan 4, 2024