Downloads · 30 days
3.2K
30% of all-time downloads
darrellbest/Qwen-Image-2.1-PE-I2I-Heretic-GGUF
Qwen-Image-2.1-PE-I2I-Heretic-GGUF is a image-text-to-text model from darrellbest. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for gguf. The card lists the license as other.
GGUF builds of darrellbest/Qwen-Image-2.1-PE-I2I-Heretic, the refusal-ablated image-editing prompt rewriter: it reads the image you are editing and turns a short instruction into a detailed edit prompt. For llama.cpp…
Downloads · 30 days
3.2K
30% of all-time downloads
All-time downloads
10.8K
Public
Repo size
34 GB
Likes
3
Public
Click a slice to open those files.
.gguf34 GB · 100%
From the Hugging Face model README
GGUF builds of darrellbest/Qwen-Image-2.1-PE-I2I-Heretic, the refusal-ablated image-editing prompt rewriter: it reads the image you are editing and turns a short instruction into a detailed edit prompt. For llama.cpp and Ollama, including machines with no CUDA GPU and ARM machines such as the DGX Spark.
Not affiliated with or endorsed by Alibaba / Qwen. Derived from
Qwen/Qwen-Image-2.1-PE-I2Iunder the Qwen Research License (copy included). Non-commercial use only.
system_prompt.txt is included and required. It defines the output contract, and the model is useless without it.
| File | Size | Notes |
|---|---|---|
Qwen-Image-2.1-PE-I2I-Heretic-BF16.gguf | 17.9 GB | Full precision, same weights as the safetensors release. |
Qwen-Image-2.1-PE-I2I-Heretic-Q8_0.gguf | 9.5 GB | Recommended. Near-lossless. |
Qwen-Image-2.1-PE-I2I-Heretic-Q4_K_M.gguf | 5.6 GB | Smallest; some quality loss. |
Qwen-Image-2.1-PE-I2I-Heretic-mmproj-F16.gguf | 0.9 GB | Vision encoder; pair it with any of the above. |
The vision file. mmproj-F16.gguf is how this model reads the input image. GGUF keeps it in a separate file;
both loaders take the pair and behave as one model.
# Modelfile
FROM ./Qwen-Image-2.1-PE-I2I-Heretic-Q8_0.gguf
FROM ./Qwen-Image-2.1-PE-I2I-Heretic-mmproj-F16.gguf
SYSTEM """<paste the contents of system_prompt.txt>"""
ollama create pe-i2i-heretic -f Modelfile
ollama run pe-i2i-heretic "make it look like winter" ./photo.png
Ollama packs the two files into a single model, so nothing extra is needed at run time.
llama-cli -m Qwen-Image-2.1-PE-I2I-Heretic-Q8_0.gguf --mmproj Qwen-Image-2.1-PE-I2I-Heretic-mmproj-F16.gguf \
--system-prompt-file system_prompt.txt
convert_hf_to_gguf.py from llama.cpp (bd4f514), then llama-quantize. Converting this architecture needed a
one-line fix: the Qwen converter reads mtp_num_hidden_layers with a default, but these checkpoints set it to
null, so it has to be coerced to 0 (other converters in llama.cpp already do this with or 0).
Checked after conversion: the Q8_0 build was imported into Ollama and run on a real image, and it described the picture correctly and produced a valid rewrite. The vision path works through the mmproj file.
Same prompt and input image, greedy decoding (temperature 0), one RTX PRO 6000 via Ollama. Every build produced a valid rewrite; they word it differently, as any two runs of this model would.
| Build | Speed | Valid rewrite | Rewrite length |
|---|---|---|---|
| BF16 | 56 tok/s | yes | 78 words |
| Q8_0 | 99 tok/s | yes | 88 words |
| Q4_K_M | 130 tok/s | yes | 171 words |
All three described the input image correctly, so the vision path survives quantization. Q8_0 is the safe default; Q4_K_M is the fastest and stayed coherent here, but it is the one to check on your own prompts.
See the parent card for the measured refusal rates and the damage (KL divergence) they cost.
| Model | Format | Use it with |
|---|---|---|
| PE-T2I-Heretic | bf16 safetensors | transformers / diffusers |
| PE-T2I-Heretic-GGUF | GGUF BF16 / Q8_0 / Q4_K_M | llama.cpp, Ollama |
| PE-T2I-Heretic-NVFP4 | NVFP4 (compressed-tensors) | vLLM on Blackwell |
| PE-I2I-Heretic | bf16 safetensors | transformers / diffusers |
| PE-I2I-Heretic-GGUF | GGUF BF16 / Q8_0 / Q4_K_M (+ mmproj) | llama.cpp, Ollama |
| PE-I2I-Heretic-NVFP4 | NVFP4 (compressed-tensors) | vLLM on Blackwell |
T2I rewrites a short request into a detailed prompt for new images; I2I rewrites an edit instruction, reading the image being edited. Both are prompt rewriters for Qwen-Image-2.1, not image generators.