FLUX.2-klein-9B-ov-int4

FLUX.2-klein-9B — OpenVINO INT4

OpenVINO IR export of black-forest-labs/FLUX.2-klein-9B for local text-to-image generation and image editing in Fern. The source model uses one architecture for both tasks; this repository contains converted OpenVINO components, not the original Diffusers checkpoint.

Export details

• Export revision: 74a4022819d82a0574a75ab138b4d908e85e6796 (use this revision for reproducible downloads).
• Size: approximately 8.964 GiB across 27 files.
• Quantization: Optimum Intel weight-only quantization. The text encoder and transformer use INT4 weights (group size 128, configured ratio 0.8); the VAE encoder and decoder use INT8. Tokenizer and scheduler assets are included.
• Pipeline: OVFlux2KleinPipeline from Optimum Intel.
• Fern defaults: 4 inference steps and guidance scale 1.0. Fern supports 256–1920 pixel dimensions divisible by 16; actual speed and memory use depend on the selected device and resolution.
• Validation scope: this export is integrated in Fern’s generation and reference-image editing workflow. No cross-device performance or quality benchmark is claimed here.

Use

In Fern, install FLUX.2 Klein 9B from Preferences → Image models. Fern downloads the selected pinned export and uses the same OpenVINO IR on its supported OpenVINO devices. The first load compiles device-specific caches locally.

For direct use with Fern’s runtime dependencies:

from huggingface_hub import snapshot_download
from optimum.intel import OVFlux2KleinPipeline

model_dir = snapshot_download(
    repo_id="xgirls/FLUX.2-klein-9B-ov-int4",
    revision="74a4022819d82a0574a75ab138b4d908e85e6796",
)
pipe = OVFlux2KleinPipeline.from_pretrained(model_dir, device="GPU")
image = pipe(
    prompt="A small glass greenhouse in a rain-soaked garden at dusk",
    width=1024,
    height=1024,
    num_inference_steps=4,
    guidance_scale=1.0,
).images[0]
image.save("output.png")

To edit an image, pass an image to the pipeline’s image= argument together with the prompt. For Fern’s NVIDIA adapter, the OpenVINO NVIDIA plugin must be installed and the device name is NVIDIA; Intel GPU uses GPU, and CPU fallback uses CPU.

License and source

The upstream FLUX Non-Commercial License applies to this model and its derivatives. It restricts use to non-commercial, non-production purposes and includes additional conditions. Read the complete license before using or redistributing this export.

The upstream 9B repository is gated and requires agreement to the FLUX Non-Commercial License. Access to this converted repository does not change or remove the source model’s license restrictions.

This is a community conversion for Fern, not an official Black Forest Labs or Intel release. FLUX and Black Forest Labs are not affiliated with or endorsing this repository.