Downloads · 30 days
76
11% of all-time downloads
MorinoNushi/DeepSeek-V4-Flash-0731-heretic-GGUF
DeepSeek-V4-Flash-0731-heretic-GGUF is a machine learning model from MorinoNushi. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
⚠️ Content warning: This model has had its refusal behavior surgically suppressed. It will comply with requests the base model refuses, including requests that are harmful, unethical, offensive, or illegal. It has red…
Downloads · 30 days
76
11% of all-time downloads
All-time downloads
695
Public
Repo size
162 GB
Likes
2
Public
Click a slice to open those files.
.gguf162 GB · 100%
From the Hugging Face model README
⚠️ Content warning: This model has had its refusal behavior surgically suppressed. It will comply with requests the base model refuses, including requests that are harmful, unethical, offensive, or illegal. It has reduced safety guardrails. See Responsible use below — you are solely responsible for what you do with it.
This is a decensored / "abliterated" variant of DeepSeek-V4-Flash-0731 (284B total / 13B active MoE, MIT license), produced with heretic-gguf — a GGUF-native port of Heretic's Optuna-optimized directional ablation, which runs the whole search directly on quantized GGUF weights via llama.cpp.
This repository contains the merged, ready-to-run model (UD-Q8_K_XL,
5 shards): the ablation is baked directly into the weights, no adapter
needed. It was produced by copy-and-patch from the official Unsloth
UD-Q8_K_XL — every tensor except the ablated ones is byte-identical to
the base; the edited tensors went through one extra requantization step
(a small, tensor-local rounding error). If you want the lossless option,
a rank-1 LoRA adapter GGUF with the identical ablation is published at
MoriNoNushi/DeepSeek-V4-Flash-0731-heretic-GGUF-lora
— apply it on top of any base quant with llama-server --lora.
heretic-gguf is available at github.com/MoriNoNushi/heretic-gguf — the full tool, so the method can be applied to other GGUF models.
In initial hands-on testing the abliterated model shows excellent general capabilities — responses remain coherent, detailed on normal tasks — and it has not refused a prompt during personal testing. (Anecdotal, not a benchmark; see the measured numbers below.)
Measured on a held-out eval set of 140 harmful prompts (100 from
mlabonne/harmful_behaviors test + 40 custom) and 100 harmless prompts
(mlabonne/harmless_alpaca test), greedy decoding, 100-token responses,
against the UD-Q8_K_XL base:
| Refusal rate (harmful prompts) | KL divergence (harmless prompts) | |
|---|---|---|
| Base model | 99.29% (139/140) | 0 (by definition) |
| This model | 14.29% (20/140) | 0.0569 |
Refusals are counted by refusal-keyword matching (English + Chinese markers); KL divergence is measured on first-token logits on harmless prompts, so lower = less collateral damage to normal behavior. This configuration was the Pareto-optimal point of a 387-trial Optuna study: the only trial with fewer refusals cost KL 0.089 (57% more drift), and the only trial tying its refusal rate had strictly higher KL. (Scores were measured on the lossless adapter overlay; the merged weights implement the identical ablation, up to the one requantization step described above.)
llama-server \
-m DeepSeek-V4-Flash-0731-heretic-UD-Q8_K_XL-00001-of-00005.gguf \
--jinja
Add your usual offload/context flags (-ngl 999, -c, tensor splits,
etc.) — nothing model-specific is required, and no special sampling
parameters are needed.
followup3, trial 25): global direction
scope, direction index 21.05 of 43 layers; attn max weight 4.49 @ layer 29;
routed-expert MLP max weight 1.06 (per-expert strengths scaled by measured
harmful/harmless routing frequency); shared-expert weight 0.48.The base model is MIT-licensed (see the base repo); this model inherits those terms. The heretic-gguf tooling used to produce it is AGPL-3.0-or-later.