Downloads · 30 days
4.2K
2% of all-time downloads
Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix
MN-12B-Lyra-v4-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for nemo. The card lists the license as cc-by-nc-4.0.
Downloads · 30 days
4.2K
2% of all-time downloads
All-time downloads
205K
Public
Repo size
153 GB
Likes
42
Public
Click a slice to open those files.
.gguf153 GB · 100%
From the Hugging Face model README
Model name: <br> MN-12B-Lyra-v4
Brief description: <br> A finetune of Mistral Nemo by Sao10K. <br> Uses the ChatML prompt format. <br>
[!TIP] Presets: <br> You can use the built in ChatML presets within SillyTavern and adjust from there. <br> Alternatively, check out Virt-io's ChatML v1.9 presets here, make sure you read the repository page for how to use them properly.
[!NOTE] Request page: <br> https://huggingface.co/Lewdiculous/Model-Requests/discussions/75
Model link: <br> https://huggingface.co/Sao10K/MN-12B-Lyra-v4
Quantized with llama.cpp: <br> b3707
