Downloads · 30 days
1.4K
5% of all-time downloads
Lewdiculous/Violet_Magcap-12B-GGUF-IQ-Imatrix
Violet_Magcap-12B-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Downloads · 30 days
1.4K
5% of all-time downloads
All-time downloads
28K
Public
Repo size
103 GB
Likes
30
Public
Click a slice to open those files.
.gguf103 GB · 100%
From the Hugging Face model README
Here I share my personal GGUF-Imatrix quants of Violet_Magcap-12B. <br>
sillytavern, presets, mistral, chatml,
roleplay, conversational, reasoning, smart
[!IMPORTANT] "It will help you solve problems. It will also make you question your existence." <br> "Use wisely—or don't." <br>
Please check out the original model card as well for added context and model information.
[!TIP] Discussions <br>
- General discussion and author feedback. <br> Feedback is always welcome for potential issues with quants and as a way to guide the author in the future iterations. <br> Your comments for them are appreciated!
<details> <summary>[Click Here] [Please Read] - Additional setup. </summary>[!NOTE] SillyTavern <br>
- [SillyTavern Presets] <br> Initially recommended master-import presets and an additional quick-replies set.
Reasoning Block + Prefix:

ChatML Format:

Mistral Format:
