Downloads · 30 days
7
3% of all-time downloads
Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2
BagelMIsteryTour-v2-8x7B-3.5bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Exllama quant of ycros/BagelMIsteryTour-v2-8x7B
Downloads · 30 days
7
3% of all-time downloads
All-time downloads
268
Public
Repo size
20.7 GB
Likes
3
Public
Click a slice to open those files.
.safetensors20.7 GB · 100%
From the Hugging Face model README
Exllama quant of ycros/BagelMIsteryTour-v2-8x7B
EXL2: 8bpw, 6bpw, 5bpw, 4bpw, 3.5bpw
It is noted to also work with mistral
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Input:
{input}
### Response:
Kooten on discord
ko-fi.com/kooten if you would like to support me