Downloads · 30 days
501
8% of all-time downloads
Lewdiculous/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-GGUF-IQ-Imatrix
ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository hosts GGUF-IQ-Imatrix quantizations for eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO.
Downloads · 30 days
501
8% of all-time downloads
All-time downloads
6.7K
Public
Repo size
63 GB
Likes
5
Public
Click a slice to open those files.
.gguf63 GB · 100%
From the Hugging Face model README
This repository hosts GGUF-IQ-Imatrix quantizations for eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO.
This is experimental.
quantization_options = [
"Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M",
"Q5_K_S", "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XS", "IQ3_XXS"
]