Downloads · 30 days
0
Cosmos3-Super-Text2Image-4Step-INT4-G64-BF16
JuliaML/Cosmos3-Super-Text2Image-4Step-INT4-G64-BF16
Cosmos3-Super-Text2Image-4Step-INT4-G64-BF16 is a text-to-image model from JuliaML. Use it when you need an image from a text prompt. It is set up for diffusers. The card lists the license as other.
Independent transformer-only quantization of nvidia/Cosmos3-Super-Text2Image-4Step. This is not an official NVIDIA release.
Access
Public
Updated Aug 8, 2026
Parameters
33.8B
38.3 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors38.3 GB · 100%
Parameter types
How the weights are stored.
U831.2B · 92%
Base models
Model card
From the Hugging Face model README
Cosmos3 Super Text-to-Image 4-Step — INT4 G64 BF16
Independent transformer-only quantization of
nvidia/Cosmos3-Super-Text2Image-4Step.
This is not an official NVIDIA release.
Base revision: 0573a4b26b8e15d13d416e51f4680c8bc8b8c33d.
Runtime, verification and benchmark code:
gtrg55/cosmos3-quant-mlx-cuda.
Format
| Property | Value |
|---|---|
| Quantization | weight-only signed symmetric INT4 (W4A16) |
| Group size | 64 |
| Compute / activations | BF16 |
| BF16 transformer I/O | proj_in, proj_out |
| Quantized matrices | 898 |
| Transformer safetensors | 35.70 GiB |
| SVD / Hadamard / dynamic allocation | disabled |
| Base sampler | original distilled 4-step schedule, guidance 1.0 |
The repository contains the quantized transformer. Tokenizer, VAE and scheduler are loaded from the original NVIDIA model.
Validation status
- Apple MLX / M4 Max: validated end-to-end at 1024×1024.
- Checkpoint packing: exact sample round-trip verified.
- CUDA: loader and test command are supplied in the companion code repo; publish a CUDA performance claim only after completing the included RunPod test.
Reference M4 Max result: 75.43 seconds generation, 38.97 GiB MLX peak memory. Hardware, thermals and software versions affect timings.
Download and run on Apple Silicon
hf download nvidia/Cosmos3-Super-Text2Image-4Step \
--revision 0573a4b26b8e15d13d416e51f4680c8bc8b8c33d \
--local-dir models/Cosmos3-Super-Text2Image-4Step
hf download JuliaML/Cosmos3-Super-Text2Image-4Step-INT4-G64-BF16 \
--local-dir checkpoints/Cosmos3-INT4
python mlx/run_pipeline.py \
--model models/Cosmos3-Super-Text2Image-4Step \
--checkpoint checkpoints/Cosmos3-INT4/transformer \
--prompt prompts/winter-spruce-tall-1024.json \
--latents benchmarks/latents/cpu-seed1143-1024x1024-bf16.safetensors \
--output outputs/int4.png \
--height 1024 --width 1024 --seed 1143
Runtime code and pinned requirements are maintained in the companion GitHub repository.
Reproducibility assets
examples/ contains the exact structured prompt, fixed BF16 latent, generation
configuration, output image and run report. Important hashes:
- prompt SHA-256:
3271fe4b38b1882cde4d3c87a4d4ae260c568cf4ab2d35c5d0f32bb12b1ba936 - latent SHA-256:
6504206b2452a23680cac73d5763e3796260f7582f40ff59e6613cdb33f0aca6 - reference PNG SHA-256:
23980b0c076f30915c71ec515de8d1e0d3b18138a6b797d9edb683703278c121
Limitations
- INT4 can change composition and fine detail relative to BF16 even with fixed initial latents.
- This is weight-only quantization, not integer activation inference.
- The included sample is one controlled prompt, not a comprehensive quality evaluation.
- Safety behavior is inherited from the base pipeline and the user's runtime configuration.
License and attribution
Distributed under OpenMDW-1.1. See LICENSE and NOTICE. The original NVIDIA
notices and license must remain with redistributed model materials.
- Task
- Text-to-Image
- Library
- diffusers
- License
- other
- Created
- Aug 8, 2026
- Updated
- Aug 8, 2026