Downloads · 30 days
71
1% of all-time downloads
asmanovlev/veriloop-coder-e1-heretic-i1-GGUF
veriloop-coder-e1-heretic-i1-GGUF is a text generation model from asmanovlev. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quants of VeriLoop Coder E1 (Qwen3.6-27B, coding-tuned) with the refusal direction abliterated (heretic / LoRA-merge), quantized with imatrix importance calibration.
Downloads · 30 days
71
1% of all-time downloads
All-time downloads
9.6K
Public
Repo size
108 GB
Likes
0
Public
Click a slice to open those files.
.gguf79.1 GB · 100%
From the Hugging Face model README
GGUF quants of VeriLoop Coder E1 (Qwen3.6-27B, coding-tuned) with the refusal direction abliterated (heretic / LoRA-merge), quantized with imatrix importance calibration.
--export-strategy=ADAPTER, then the LoRA was merged into the base weights.harmful_behaviors. The model is less censorious but still refuses many requests — Qwen 3.6's four PEFT-adapters distribute refusal patterns across multiple subspaces, so a single direction was hard to find.| File | Quant | Size | Notes |
|---|---|---|---|
VeriLoop-Coder-E1-Abliterated-Q8_0.gguf | Q8_0 | 26.6 GB | Reference (no imatrix needed) |
abl_iq4_nl.gguf | IQ4_NL | 14.7 GB | Best quality/size balance |
abl_iq4_xs.gguf | IQ4_XS | 14.1 GB | Faster, slightly lower quality |
abl_iq3_xxs.gguf | IQ3_XXS | 10.4 GB | Good for 12-16 GB VRAM |
abl_iq2_xxs.gguf | IQ2_XXS | 7.9 GB | Fits 8 GB VRAM, quality drops |
imatrix.dat | — | 10 MB | Importance matrix used for IQ quants |
All IQ quants were produced with the included imatrix.dat (code-focused calibration dataset).
llama-cli -m abl_iq4_nl.gguf -p "def fib(n):" -n 64
# or with a server:
llama-server -m abl_iq4_nl.gguf -c 8192 --port 8080
imatrix.dat can be re-applied with llama-quantize --imatrix imatrix.dat if you want to re-quantize.
Apache-2.0 (same as the original).