Downloads · 30 days
264
83% of all-time downloads
bghira/anima-anyflow-e621-stage1
anima-anyflow-e621-stage1 is a text-to-image model from bghira. Use it when you need an image from a text prompt. It is set up for diffusers. The card lists the license as other.
ComfyUI support: SimpleTuner-io/ComfyUI-AnyFlow is the canonical AnyFlow ComfyUI integration and ships with a ready-made workflow for Anima few-step inference.
Downloads · 30 days
264
83% of all-time downloads
All-time downloads
318
Public
Repo size
14.4 GB
Likes
1
Public
Click a slice to open those files.
.safetensors9.7 GB · 63%
From the Hugging Face model README
ComfyUI support: SimpleTuner-io/ComfyUI-AnyFlow is the canonical AnyFlow ComfyUI integration and ships with a ready-made workflow for Anima few-step inference.
This adapter is the forward MeanFlow pretraining stage of the AnyFlow two-stage distillation recipe. Mean-matching alone converges to structurally correct but characteristically soft, low-contrast outputs — that is expected, and it is why this stage exists only as the initialization for the on-policy DMD stage that restores sharpness. Use one of the finished stage-2 adapters for few-step inference instead:
In all four runs the live (non-EMA) weights are the ship candidate — DMD's adversarial dynamics mean weight-averaging blurs; start with dmd-v3's live weights.
This is a PEFT LoRA derived from circlestone-labs/Anima-Base-v1.0-Diffusers.
The main validation prompt used during training was:
masterpiece, best quality, score_7, safe, anime portrait of a young woman with blue hair wearing a white jacket, clean line art, detailed eyes, soft daylight
1.00.04AnyFlowValidationScheduler (FlowMatchEulerDiscreteScheduler)421024x1024Note: The validation settings are not necessarily the same as the training settings.
You can find some example images in the following gallery:
<Gallery />The text encoder was not trained. You may reuse the base model text encoder for inference.
Training epochs: 0
Training steps: 20000
Learning rate: 0.0001
Max grad value: 1.0
Effective batch size: 16
Gradient checkpointing: True
Prediction type: flow_matching[]
Optimizer: adamw_bf16
Trainable parameter precision: Pure BF16
Base model precision: no_change
Caption dropout probability: 0.1%
LoRA Rank: 128
LoRA Alpha: 128.0
LoRA Dropout: 0.1
LoRA initialisation style: default
LoRA mode: Standard
import torch
from diffusers import DiffusionPipeline
model_id = 'circlestone-labs/Anima-Base-v1.0-Diffusers'
adapter_id = 'bghira/anima-anyflow-e621-wip'
pipeline = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.bfloat16) # loading directly in bf16
pipeline.load_lora_weights(adapter_id)
prompt = "masterpiece, best quality, score_7, safe, anime portrait of a young woman with blue hair wearing a white jacket, clean line art, detailed eyes, soft daylight"
negative_prompt = 'worst quality, low quality, score_1, score_2, score_3, blurry, cropped, artist name, signature'
## Optional: quantise the model to save on vram.
## Note: The model was not quantised during training, so it is not necessary to quantise it during inference time.
#from optimum.quanto import quantize, freeze, qint8
#quantize(pipeline.transformer, weights=qint8)
#freeze(pipeline.transformer)
pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu') # the pipeline is already in its target precision level
model_output = pipeline(
prompt=prompt,
negative_prompt=negative_prompt,
num_inference_steps=4,
generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(42),
width=1024,
height=1024,
guidance_scale=1.0,
).images[0]
model_output.save("output.png", format="PNG")
SimpleTuner generates a safetensors variant of the EMA weights and a pt file.
The safetensors file is intended to be used for inference, and the pt file is for continuing finetuning.
The EMA model may provide a more well-rounded result, but typically will feel undertrained compared to the full model as it is a running decayed average of the model weights.