Downloads · 30 days
900
4% of all-time downloads
MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix
Lewdiculous/MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix
MN-12B-Mag-Mell-R1-GGUF-IQ-ARM-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for nemo. The card lists the license as unlicense.
My GGUF-IQ-ARM-Imatrix quants for inflatebot/MN-12B-Mag-Mell-R1.
All-time downloads
23.6K
Public
Repo size
152 GB
Likes
14
Public
Repo makeup
Click a slice to open those files.
.gguf152 GB · 100%
At a glance
- Library
- nemo
- License
- unlicense
- Access
- Public
- Created
- Dec 6, 2024
- Updated
- Dec 6, 2024
- SHA
- cd1175c9
Base models
Model card
From the Hugging Face model README
My GGUF-IQ-ARM-Imatrix quants for inflatebot/MN-12B-Mag-Mell-R1.
Mag Mell R1 was tested with Temp 1.25 and MinP 0.2. This was fairly stable up to 10K, but this might be too "hot". If issues with coherency occur, try increasing MinP or decreasing Temperature.
[!NOTE] Use the ChatML prompt format.
- Library
- nemo
- License
- unlicense
- Languages
- en
- Created
- Dec 6, 2024
- Updated
- Dec 6, 2024