Downloads · 30 days
3
7% of all-time downloads
imgailab/flux1-torch-int8
flux1-torch-int8 is a text-to-image model from imgailab. Use it when you need an image from a text prompt. It is set up for diffusers. The card lists the license as apache-2.0.
This is a INT8 pytorch version of black-forest-labs/FLUX.1-schnell.
Downloads · 30 days
3
7% of all-time downloads
All-time downloads
41
Public
Repo size
12.3 GB
Likes
0
Public
Click a slice to open those files.
.bin12.3 GB · 100%
From the Hugging Face model README
This is a INT8 pytorch version of black-forest-labs/FLUX.1-schnell.
# PyTorch INT8 quantized model
from diffusers import FluxPipeline
import torch
# Load INT8 quantized model
pipe = FluxPipeline.from_pretrained(
"Mitchins/flux1-torch-int8",
torch_dtype=torch.qint8,
use_safetensors=True
)
# For CPU inference
pipe = pipe.to("cpu")
# Generate image
image = pipe("A beautiful landscape", num_inference_steps=20).images[0]
image.save("output.png")
| Backend | Quantization | Memory | Speed (CPU) | Speed (GPU) | Quality |
|---|---|---|---|---|---|
| PyTorch | INT8 | ~12.0GB | Good | Fast | Slightly Reduced |
@misc{flux1-pytorch-int8,
title = {FLUX.1 Schnell PyTorch INT8}
author = {ImageAI Server Contributors}
year = {2024}
publisher = {HuggingFace}
url = {https://huggingface.co/Mitchins/flux1-torch-int8}
}
Converted using ImageAI Server Model Converter v1.0