ml-figs-ldm

ML-FIGS-LDM

EDUCATIONAL FIGURE GENERATION USING TEXT PERCEPTUAL LOSS

ML-FIGS-LDM is a Latent Diffusion Model (LDM) for generating educational figures. The AutoencoderKL is trained using a Text Perceptual Loss to reconstruct more readable text within the figures.

Autoencoder Performance Comparison:

Note:

• AutoencoderKL_SD: Stable Diffusion v1-4 autoencoder trained on LAION.
• AutoencoderKL_TPL: Autoencoders trained with Text Perceptual Loss (TPL).
• Model A is trained on ML-Figs.
• Model B is trained on ML-Figs + SciCap.

Latent Diffusion Model:

MlFigs_LDM_12.ckpt