Downloads · 30 days
137
5% of all-time downloads
Kooten/MiquMaid-v1-70B-IQ2-GGUF
MiquMaid-v1-70B-IQ2-GGUF is a machine learning model from Kooten. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
2bit imatrix GGUF quants of NeverSleep/MiquMaid-v1-70B
Downloads · 30 days
137
5% of all-time downloads
All-time downloads
2.8K
Public
Repo size
133 GB
Likes
11
Public
Click a slice to open those files.
.gguf133 GB · 100%
From the Hugging Face model README
2bit imatrix GGUF quants of NeverSleep/MiquMaid-v1-70B
Imatrix generated from q8 of MiquMaid, 2000 chunks at 500 ctx. Dataset was Wikitext.
These quants take a while to do so please leave a like or a comment on the repo so that i know if there is interest.
2bit Imatrix GGUF: IQ2-XS, IQ2-XXS, IQ3-XXS
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Kooten on discord