Downloads · 30 days
4
1% of all-time downloads
Disty0/Qwen-Image-Lightning-SDNQ-uint4-svd-r32
Qwen-Image-Lightning-SDNQ-uint4-svd-r32 is a text-to-image model from Disty0. Use it when you need an image from a text prompt. It is set up for diffusers. The card lists the license as apache-2.0.
4 bit (UINT4 with SVD rank 32) quantization of vladmandic/Qwen-Lightning using SDNQ.
Downloads · 30 days
4
1% of all-time downloads
All-time downloads
288
Public
Parameters
10.9B
17.3 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors17.3 GB · 100%
How the weights are stored.
U810.2B · 93%
From the Hugging Face model README
4 bit (UINT4 with SVD rank 32) quantization of vladmandic/Qwen-Lightning using SDNQ.
Usage:
pip install git+https://github.com/Disty0/sdnq
import torch
import diffusers
from sdnq import SDNQConfig # import sdnq to register it into diffusers and transformers
pipe = diffusers.QwenImagePipeline.from_pretrained("Disty0/Qwen-Image-Lightning-SDNQ-uint4-svd-r32", torch_dtype=torch.bfloat16)
pipe.enable_model_cpu_offload()
prompt = "a tiny astronaut hatching from an egg on the moon, Ultra HD, 4K, cinematic composition."
negative_prompt = " "
image = pipe(
prompt=prompt,
negative_prompt=negative_prompt,
width=1024,
height=1024,
num_inference_steps=8,
true_cfg_scale=1.0,
generator=torch.manual_seed(0),
).images[0]
image.save("qwen-image-lightning-sdnq-uint4-svd-r32.png")
Original BF16 vs SDNQ quantization comparison:
| Quantization | Model Size | Visualization |
|---|---|---|
| Original BF16 | 40.9 GB | ![]() |
| SDNQ UINT4 | 11.6 GB | ![]() |