Downloads · 30 days
1.3K
13% of all-time downloads
miqu-evil-dpo-iMat-GGUF
InferenceIllusionist/miqu-evil-dpo-iMat-GGUF
miqu-evil-dpo-iMat-GGUF is a machine learning model from InferenceIllusionist. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
<img src="https://i.imgur.com/P68dXux.png" width="400"/
All-time downloads
10.2K
Public
Repo size
542 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf542 GB · 100%
At a glance
- Access
- Public
- Created
- Apr 26, 2024
- Updated
- Apr 28, 2024
- SHA
- bd03173b
Model card
From the Hugging Face model README
<img src="https://i.imgur.com/P68dXux.png" width="400"/>
miqu-evil-dpo-iMat-GGUF
Quantized from fp32 with love.
- Weighted quantizations created with .imatrix file calculated in 105 chunks and n_ctx=512 using groups_merged.txt
For a brief rundown of iMatrix quant performance please see this PR
<i>All quants are verified working prior to uploading to repo for your safety and convenience. </i>
<b>Tip:</b> Pick a size that can fit in your GPU while still allowing some room for context for best speed. You may need to pad this further depending on if you are running image gen or TTS as well.
BF16 model card can be found here
- Created
- Apr 26, 2024
- Updated
- Apr 28, 2024