Downloads · 30 days
6
11% of all-time downloads
Kooten/MiquMaid-v1-70B-4bpw-exl2
MiquMaid-v1-70B-4bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers.
Exllama quant of NeverSleep/MiquMaid-v1-70B
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
57
Public
Repo size
35 GB
Likes
1
Public
Click a slice to open those files.
.safetensors35 GB · 100%
From the Hugging Face model README
Exllama quant of NeverSleep/MiquMaid-v1-70B
EXL2: 6bpw, 5bpw, 4bpw, 3.5bpw, 3bpw, 2.4bpw
2.4bpw is probably the most you can fit in a 24gb card
GGUF: 2bit Imatrix GGUF
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Kooten on discord