Downloads · 30 days
6
11% of all-time downloads
Kooten/MiquMaid-v1-70B-2.4bpw-exl2
MiquMaid-v1-70B-2.4bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers.
Exllama quant of NeverSleep/MiquMaid-v1-70B
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
57
Public
Repo size
21.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors21.3 GB · 100%
From the Hugging Face model README
Exllama quant of NeverSleep/MiquMaid-v1-70B
EXL2: 6bpw, 5bpw, 4bpw, 3.5bpw, 3bpw, 2.4bpw
2.4bpw is probably the most you can fit in a 24gb card
GGUF: 2bit Imatrix GGUF
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Kooten on discord