Machine learningML & AI Methods

Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models

The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.