Downloads · 30 days
460
2% of all-time downloads
Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF is a text generation model from Andycurrent. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as other.
HERETIC is a reasoning-oriented variant of the Mistral-Nemo 2407 12B architecture distributed in GGUF format for efficient local inference. The model is intended for users who want a flexible conversational assistant…
Downloads · 30 days
460
2% of all-time downloads
All-time downloads
21.5K
Public
Repo size
74.7 GB
Likes
11
Public
Click a slice to open those files.
.gguf74.7 GB · 100%
From the Hugging Face model README
HERETIC is a reasoning-oriented variant of the Mistral-Nemo 2407 12B architecture distributed in GGUF format for efficient local inference.
The model is intended for users who want a flexible conversational assistant capable of analytical reasoning, long-form explanations, and open-ended dialogue while running entirely on local hardware.
This repository provides quantized versions optimized for llama.cpp–based runtimes and other compatible inference tools.
Model Name: Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC
Architecture: Mistral-Nemo (12B parameters)
Format: GGUF
Base Model: Mistral-Nemo-2407
Distribution: Quantized builds for local inference
Primary Capability: Instruction-following with extended reasoning and conversational flexibility
HERETIC focuses on encouraging multi-step reasoning and detailed responses while maintaining a natural conversational style.
This model is designed primarily for local deployments and experimentation.
Typical use cases include:
The model should not be relied upon for:
Outputs may contain inaccuracies or biased information.
The model works best with structured role-based prompts.
Example conversation template:
<|system|>
You are a helpful AI assistant.
<|user|>
Explain how neural networks learn.
<|assistant|>
Some interfaces automatically apply a compatible chat template.
This model uses the GGUF format, making it compatible with several local inference tools.
Example command:
./llama.exe -m Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q4_K_M.gguf -p "Explain quantum computing in simple terms."
Like most large language models:
Users should critically evaluate outputs before relying on them.
This model builds on contributions from several open-source projects:
This model is provided for research, experimentation, and local use. Users are responsible for ensuring that deployments comply with applicable laws and the licensing terms of the underlying base model.