flux.2-klein-4b-8bit

flux.2-klein-4b-8bit

This repository contains MLX-Gen saved weights for black-forest-labs/FLUX.2-klein-4B. The checkpoint is designed for local Apple Silicon inference with mlx-gen.

It uses the mflux/MLX saved-weight layout and MLX quantization tensors. It is not a Diffusers or Transformers from_pretrained() checkpoint.

Source Model

Original model: black-forest-labs/FLUX.2-klein-4B.

License and Access

This quantized derivative follows the Apache 2.0 license of the source model.

Quantization

This is an MLX q8 checkpoint. Quantizable modules are saved at 8-bit where the model layout supports MLX quantization; VAE weights and non-quantizable layers remain BF16.

Compatibility

Requires mlx-gen >= 0.18.2.

Generated with mlx-gen 0.18.2.

Use the mlxgen command and Python import path for new MLX-Gen projects.

Usage

python -m pip install -U mlx-gen

mlxgen download --model AbstractFramework/flux.2-klein-4b-8bit

mlxgen generate \
  --model AbstractFramework/flux.2-klein-4b-8bit \
  --prompt "Your prompt here" \
  --steps 20 \
  --seed 42 \
  --output image.png

Attribution

MLX-Gen is based on mflux by Filip Strand and the original mflux contributors. This model card is generated by MLX-Gen so derived checkpoints keep that attribution visible.

Quantized and contributed by @lpalbou.