Downloads · 30 days
4
8% of all-time downloads
LoneStriker/U-Amethyst-20B-5.0bpw-h6-exl2
U-Amethyst-20B-5.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Downloads · 30 days
4
8% of all-time downloads
All-time downloads
53
Public
Repo size
12.8 GB
Likes
1
Public
Click a slice to open those files.
.safetensors12.8 GB · 100%
From the Hugging Face model README

Attempt to recreate Amethyst-13B but in 20B. The two model was glued together with a sparkle of Unholy.
In addition, LimaRP v3 was used, is it recommanded to read the documentation.
<!-- description start -->This repo contains fp16 files of Amethyst-20B.
<!-- description end --> <!-- description start -->Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:

You can follow these instruction format settings in SillyTavern. Replace tiny with your desired response length:

Special thanks to Sushi.
If you want to support me, you can here.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 50.38 |
| ARC (25-shot) | 62.2 |
| HellaSwag (10-shot) | 83.11 |
| MMLU (5-shot) | 55.88 |
| TruthfulQA (0-shot) | 53.2 |
| Winogrande (5-shot) | 74.19 |
| GSM8K (5-shot) | 5.31 |
| DROP (3-shot) | 18.75 |