Downloads · 30 days
1.1K
5% of all-time downloads
MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix
Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix
MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
My GGUF-IQ-Imatrix quants for Sao10K/MN-BackyardAI-Party-12B-v1.
All-time downloads
21.9K
Public
Repo size
166 GB
Likes
16
Public
Repo makeup
Click a slice to open those files.
.gguf166 GB · 100%
At a glance
- Library
- transformers
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Oct 2, 2024
- Updated
- Oct 3, 2024
- SHA
- 0f400b49
Base models
Model card
From the Hugging Face model README
My GGUF-IQ-Imatrix quants for Sao10K/MN-BackyardAI-Party-12B-v1.
"For best results, set both <|im_end|> and [INST] as stopping strings. Recommended Temperature is <1 , min_p of at least 0.1."
"This does require a lot of tinkering to fit within SillyTavern / other frontends."
[!NOTE] Prompting:
- Similar to Mistral for group chats (please read the original model page for information on this)
- ChatML for one-on-one chats
- Library
- transformers
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Oct 2, 2024
- Updated
- Oct 3, 2024