flux2-klein-GGUF

FLUX.2 klein 9B — GGUF build

9B step-distilled text-to-image — 4 inference steps, ~8s per 1024² image on an A100.

What this repo is: a requantized, split-layout build of the upstream model — weights only, not a retrain. The recommended settings below are the values these weights are actually run with day to day, not copied from the upstream card.

---

Samples

<table> <tr><td><img src="https://huggingface.co/ChrisColeTech/flux2-klein/resolve/main/samples/apple.png" width="380" alt="prompt: a red apple on a rustic wooden table beside a window, soft daylight, fine skin texture and wood grain, studio photograph, sharp focus — 1024×1024, 4 steps, guidance 1.0, seed 12345"></td><td><img src="https://huggingface.co/ChrisColeTech/flux2-klein/resolve/main/samples/portrait.png" width="380" alt="prompt: portrait of an older fisherman with a weathered face, natural window light, shallow depth of field, photorealistic — 1024×1024, 4 steps, guidance 1.0, seed 99"></td></tr> <tr><td>_{**prompt:** `a red apple on a rustic wooden table beside a window, soft daylight, fine skin texture and wood grain, studio photograph, sharp focus` — 1024×1024, 4 steps, guidance 1.0, seed 12345}</td><td>_{**prompt:** `portrait of an older fisherman with a weathered face, natural window light, shallow depth of field, photorealistic` — 1024×1024, 4 steps, guidance 1.0, seed 99}</td></tr> <tr><td><img src="https://huggingface.co/ChrisColeTech/flux2-klein/resolve/main/samples/street.png" width="380" alt="prompt: a rain-slicked Tokyo street at night, neon signs reflecting in puddles, cinematic, 35mm photograph — 1024×1024, 4 steps, guidance 1.0, seed 1234"></td><td></td></tr> <tr><td>_{**prompt:** `a rain-slicked Tokyo street at night, neon signs reflecting in puddles, cinematic, 35mm photograph` — 1024×1024, 4 steps, guidance 1.0, seed 1234}</td><td></td></tr> </table>

---

img2img

One source, three prompts, identical settings — so the difference you see is the prompt.

<table> <tr><td><img src="https://huggingface.co/ChrisColeTech/flux2-klein-GGUF/resolve/main/samples/img2img-source.png" width="230" alt="source photograph"></td><td><img src="https://huggingface.co/ChrisColeTech/flux2-klein-GGUF/resolve/main/samples/img2img-oil.png" width="230" alt="oil render"></td><td><img src="https://huggingface.co/ChrisColeTech/flux2-klein-GGUF/resolve/main/samples/img2img-watercolor.png" width="230" alt="watercolor render"></td><td><img src="https://huggingface.co/ChrisColeTech/flux2-klein-GGUF/resolve/main/samples/img2img-sketch.png" width="230" alt="sketch render"></td></tr> <tr><td>_{**source** — one photograph, used for all three}</td><td>_{**img2img prompt:** `An oil painting of a dramatic mountain landscape at sunset, thick impasto brushstrokes` — 1024×1024, **24 steps**, **guidance 4.0**, **strength 0.90**, seed 42}</td><td>_{**img2img prompt:** `A watercolor painting of a mountain valley at dawn, soft wet-on-wet washes` — 1024×1024, **24 steps**, **guidance 4.0**, **strength 0.90**, seed 42}</td><td>_{**img2img prompt:** `A detailed pencil sketch of a mountain landscape in warm sepia and sanguine tones` — 1024×1024, **24 steps**, **guidance 4.0**, **strength 0.90**, seed 42}</td></tr> </table>

Do not run img2img at the txt2img step count

This model's txt2img preset is 4 steps — it is a distilled 4-step model and that is correct for text-to-image. Running img2img at 4 steps produces output indistinguishable from the source at every strength from 0.3 to 0.9: there is not enough schedule left to restyle anything.

At 24 steps with guidance 4.0 — the settings this repo's own img2img integration test uses — it restyles properly. The three results above are the same photograph as oil, watercolour and pencil, with the composition intact in each and the medium genuinely different rather than a colour filter.

If img2img appears to do nothing, check the step count before anything else.

Recommended settings

Values this build is run with in practice. They are read out of a live config when this card is generated, so they cannot drift from what is actually used.

Supported modes: txt2img, img2img

Notes and gotchas

• 4 steps is not a typo. FLUX.2 [klein] is step-distilled to 4 inference steps at guidance 1.0, per the upstream model card.
• Do not run this at 50 steps / guidance 4.0. An earlier preset did exactly that — roughly 10× slower (measured 78s → 8s on the A100) and the wrong guidance for a guidance-distilled model.
• img2img strength 0.90 is the verified value for this build.

---

Layout

Components ship as separate files rather than one bundle: the transformer, the text encoder(s) and the VAE each load independently, with configs and tokenizers under config/. Any loader that accepts explicit per-component paths can consume this directly — point it at the files listed below.

A generic diffusers snippet is deliberately omitted. This is a repacked split layout with substituted encoders, so an upstream example will not load it unmodified, and an untested snippet would be worse than none.

---

Files

---

Provenance

• Upstream base model: black-forest-labs/FLUX.2-klein-9B (upstream license: other)
• This build: requantized and relaid out into a split component layout. Weights are not retrained; only the format and directory layout differ.
• License: left as unknown in this repo's metadata. Refer to the upstream model's license for redistribution and commercial-use terms — several of these bases are non-commercial.