U-Amethyst-20B-exl2

Exllama 2 version of model created by the work of Undi95

Original Card https://huggingface.co/Undi95/U-Amethyst-20B

Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.

Main branch is 5bpw 6h

---

Attempt to recreate Amethyst-13B but in 20B. The two model was glued together with a sparkle of Unholy.

In addition, LimaRP v3 was used, is it recommanded to read the documentation.

<!-- description start -->

Description

This repo contains fp16 files of Amethyst-20B.

<!-- description end --> <!-- description start -->

Models and loras used

• Xwin-LM/Xwin-LM-13B-V0.1
• The-Face-Of-Goonery/Huginn-13b-FP16
• zattio770/120-Days-of-LORA-v2-13B
• lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT
• Undi95/Unholy-v1-12L-13B

<!-- description end --> <!-- prompt-template start -->

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

LimaRP v3 usage and suggested settings

You can follow these instruction format settings in SillyTavern. Replace tiny with your desired response length:

Special thanks to Sushi.

If you want to support me, you can here.