Downloads · 30 days
1.3K
15% of all-time downloads
Abiray/Huihui-Ministral-3B-Instruct-2512-abliterated-GGUF
Huihui-Ministral-3B-Instruct-2512-abliterated-GGUF is a text generation model from Abiray. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
This repository contains GGUF Quantizations of the Huihui-Ministral-3B-Instruct-2512-abliterated model.
Downloads · 30 days
1.3K
15% of all-time downloads
All-time downloads
8.8K
Public
Repo size
12.9 GB
Likes
5
Public
Click a slice to open those files.
.gguf12.9 GB · 100%
From the Hugging Face model README
This repository contains GGUF Quantizations of the Huihui-Ministral-3B-Instruct-2512-abliterated model.
The model is based on Ministral 3B, which has been "abliterated" (uncensored) to remove refusal mechanisms. This modification makes it highly responsive and capable of handling complex, unrestricted creative writing tasks. These GGUF files are strictly optimized for high-performance local inference on edge devices, laptops, and consumer-grade hardware.
This model is engineered for efficient local inference on hardware with limited VRAM. It is compatible with major GGUF inference engines including:
It is particularly effective for Creative Writing, Interactive Assistants, and Narrative Generation on edge devices where cloud latency or privacy is a concern. The "abliterated" nature ensures the model follows instructions precisely without unnecessary refusals.
Warning: Uncensored Model This model has undergone "abliteration," a technique that selectively removes safety guardrails.
To prevent the model from generating artifacts (like +++++) or hallucinating user replies at the end of a response, ensure your inference tool uses the following stop sequences:
</s>User:Assistant:You can pull this model directly to your command line:
ollama run hf.co/Abhiray/Huihui-Ministral-3B-Instruct-2512-abliterated-GGUF:Q4_K_M