Downloads · 30 days
10
4% of all-time downloads
Kooten/BagelMIsteryTour-v2-8x7B-5bpw-exl2
BagelMIsteryTour-v2-8x7B-5bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Exllama quant of ycros/BagelMIsteryTour-v2-8x7B
Downloads · 30 days
10
4% of all-time downloads
All-time downloads
224
Public
Repo size
29.4 GB
Likes
0
Public
Click a slice to open those files.
.safetensors29.4 GB · 100%
From the Hugging Face model README
Exllama quant of ycros/BagelMIsteryTour-v2-8x7B
EXL2: 8bpw, 6bpw, 5bpw, 4bpw, 3.5bpw
It is noted to also work with mistral
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Input:
{input}
### Response:
Kooten on discord
ko-fi.com/kooten if you would like to support me