Krea-2-Turbo-Diffusers-FP8

Krea 2 Turbo — Native Diffusers TorchAO FP8

<div align="center">

</div>

This repository provides a native, drop-in Hugging Face Diffusers pipeline for krea/Krea-2-Turbo quantized to FP8 using PyTorch's official optimization library TorchAO.

---

🎨 Sample Showcase (Native FP8 Diffusers)

All samples generated with 8 steps, guidance scale 0.0 at 1024x1024 on an NVIDIA RTX 4090:

<div align="center"> <img src="samples/krea2_fp8_grid.jpg" width="800" alt="Krea 2 Turbo TorchAO FP8 4-Grid Showcase" /><br/> <br/> </div> <details> <summary><b>🔍 Click to view prompt details for each quadrant:</b></summary> <br/>

1. Top-Left (Iced Matcha Latte):
   "A crisp, condensation-covered glass of iced matcha latte on a modern concrete kitchen counter, soft morning side-light, commercial food photography, 8k resolution."

2. Top-Right (Red Fox in Snow):
   "A vibrant red fox sitting in crisp white snow at golden hour, photorealistic, sharp focus, 8k resolution."

3. Bottom-Left (Minimalist Workspace):
   "A sleek silver laptop on a minimalist wooden desk with a ceramic coffee mug and a small succulent, soft diffused daylight."

4. Bottom-Right (Japanese Rock Garden):
   "A serene Japanese rock garden surrounded by autumn red maple leaves, misty morning atmosphere, 8k resolution photorealistic."

</details>

---

⚡ Key Highlights

• Standard Diffusers Drop-in: Loadable directly via Krea2Pipeline.from_pretrained(...) with native Diffusers.
• Hardware Target (Ada Lovelace, Hopper & Newer): Total model weights occupy 17.7 GB VRAM, fitting comfortably within 24 GB GPUs (e.g., RTX 4090, RTX 4500/6000 Ada, L40, L40S, L4) with headroom for VAE decode. (Ampere GPUs like RTX 3090/A100 will benefit from memory savings, but require Ada+ for native FP8 Tensor Core compute acceleration).
• Dynamic Per-Row FP8 (W8A8): Transformer linear projections are quantized using TorchAO Float8DynamicActivationFloat8WeightConfig(granularity=PerRow()).
• Quantized Text Encoder: The Qwen3-VL-4B text encoder is quantized using TorchAO Float8WeightOnlyConfig(), reducing text encoder footprint from 8.88 GB to 4.40 GB.
• Distilled 8-Step Schedule: Configured for the official distilled schedule (num_inference_steps=8, guidance_scale=0.0).

---

📦 Installation

Ensure you have the latest PyTorch, Diffusers, Transformers, and TorchAO installed:

pip install --upgrade torch torchvision --extra-index-url https://download.pytorch.org/whl/cu124
pip install git+https://github.com/huggingface/diffusers.git
pip install "transformers>=4.49.0" torchao accelerate safetensors sentencepiece

---

🚀 Quickstart Usage

import torch
from diffusers import Krea2Pipeline

# Load the official FP8 pipeline directly from Hugging Face
pipe = Krea2Pipeline.from_pretrained(
    "kavi-labs/Krea-2-Turbo-Diffusers-FP8",
    torch_dtype=torch.bfloat16
)
pipe.to("cuda")

# Optional: If running on a GPU with tight memory (<24 GB), use CPU offload instead:
# pipe.enable_model_cpu_offload()

# Optional: Further accelerate inference with torch.compile
# pipe.transformer = torch.compile(pipe.transformer, mode="max-autotune")

# Generate an image in 8 steps
prompt = (
    "A crisp, condensation-covered glass of iced matcha latte on a modern "
    "concrete kitchen counter, soft morning side-light, commercial food photography, 8k resolution."
)

image = pipe(
    prompt=prompt,
    width=1024,
    height=1024,
    num_inference_steps=8,
    guidance_scale=0.0,
    generator=torch.Generator("cuda").manual_seed(42)
).images[0]

image.save("matcha_latte.png")
print("✅ Image saved to matcha_latte.png")

---

📊 VRAM & Precision Breakdown

Component Specifications

Memory Comparison & GPU Target

⚡ Verified Benchmarks (NVIDIA RTX 4090)

Measured in live production tests at 1024x1024 resolution with 8 steps on an NVIDIA GeForce RTX 4090:

---

☕ Support My Work

If you find this model conversion helpful and it saved you compute or GPU hours, consider supporting me! Every coffee helps keep open-source developer experiments and tools going:

<div align="center">

</div>

---

📜 Credits & License

• Original Base Model: krea/Krea-2-Turbo created by Krea AI.
• Diffusion Pipeline: Hugging Face Diffusers team.
• Quantization Engine: PyTorch TorchAO team.
• This checkpoint is provided in accordance with the Krea 2 Community License Agreement and Acceptable Use Policy.