Downloads · 30 days
0
JoyAI-Image-Edit-NF4
SanDiegoDude/JoyAI-Image-Edit-NF4
JoyAI-Image-Edit-NF4 is a machine learning model from SanDiegoDude. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Pre-quantized NF4 (4-bit) version of the JoyAI-Image-Edit DiT transformer, created with bitsandbytes.
Access
Public
Updated Apr 4, 2026
Repo size
8.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors8.4 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026
- SHA
- bcfc5891
Base models
Model card
From the Hugging Face model README
JoyAI-Image-Edit — NF4 4-bit Pre-Quantized Transformer
Pre-quantized NF4 (4-bit) version of the JoyAI-Image-Edit DiT transformer, created with bitsandbytes.
Key Details
| Property | Value |
|---|---|
| File size | 7.83 GB (vs 31 GB bf16, 16 GB FP8) |
| Quantization | NF4 (bitsandbytes, double quantization) |
| Layers quantized | 326 nn.Linear → Linear4bit |
| Source weights | SanDiegoDude/JoyAI-Image-Edit-Safetensors (bf16) |
| Tested on | NVIDIA RTX 4090 (24 GB), NVIDIA GB10 |
This file loads directly in seconds — no runtime quantization needed.
Inference Tool
A Gradio UI, CLI, and REST API are available at SanDiegoDude/JoyAI-Image.
Quick Start
git clone https://github.com/SanDiegoDude/JoyAI-Image.git
cd JoyAI-Image
python -m venv .venv && source .venv/bin/activate
pip install -e . && pip install bitsandbytes
# Gradio UI — auto-downloads this NF4 checkpoint + VAE + text encoder
python app.py --nf4-dit --4bit-vlm
# CLI
python inference.py --prompt "your prompt" --nf4-dit --4bit-vlm
Models are auto-downloaded from HuggingFace on first run.
VRAM Usage (approximate)
| Component | VRAM |
|---|---|
| NF4 DiT (this file) | ~7.8 GB (resident on GPU) |
| 4-bit VLM text encoder | ~4.4 GB (offloaded after encoding) |
| VAE decode | ~0.5 GB |
| Peak during denoising | ~12 GB |
Fits comfortably on 24 GB GPUs.
Related Repos
- bf16 weights (source): SanDiegoDude/JoyAI-Image-Edit-Safetensors
- FP8 weights: SanDiegoDude/JoyAI-Image-Edit-FP8
- Inference code: SanDiegoDude/JoyAI-Image
- Original model: jdopensource/JoyAI-Image-Edit
- License
- apache-2.0
- Created
- Apr 4, 2026
- Updated
- Apr 4, 2026