---
title: Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variations
url: https://www.ml-quant.com/papers/arxiv/2405.14857/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2405.14857
source_url: https://arxiv.org/pdf/2405.14857
featured: 2024-05-28
citations: 0
topic: ML & AI Methods
---


# Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variations

Semantica, an image-conditioned diffusion model, can generate new images based on the semantics of a conditioning image, without the need for fine-tuning.

- Source: https://arxiv.org/pdf/2405.14857
- Identifier: arXiv:2405.14857
- Released: 2024-05-23
- First featured: Quant Letter No. 51 (2024-05-28): https://www.ml-quant.com/issues/2024-05-28/
- Citations (Semantic Scholar): 0
- Published in: not yet
- Topic: ML & AI Methods

## Related

- [Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control](https://www.ml-quant.com/papers/arxiv/2409.08861/): The study presents Adjoint Matching, a new algorithm that enhances dynamical generative models by refining reward fine-tuning, leading to improved consistency, realism, and adaptability to unseen human preference reward models.
- [DITTO: Diffusion Inference-Time T-Optimization for Music Generation](https://www.ml-quant.com/papers/arxiv/2401.12179/): Music Optimization: The DITTO framework allows control of pre-trained text-to-music diffusion models at inference-time, enabling music generation without fine-tuning.
- [CAT3D: Create Anything in 3D with Multi-View Diffusion Models](https://www.ml-quant.com/papers/arxiv/2405.10314/): Multi-View Diffusion Models: CAT3D is a novel technique for generating 3D scenes from any number of images, surpassing existing methods in speed and efficiency.
- [Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models](https://www.ml-quant.com/papers/arxiv/2501.01423/): The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.
- [Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps](https://www.ml-quant.com/papers/arxiv/2501.09732/): The research shows that increasing computation during inference-time can enhance the quality of samples produced by diffusion models, especially in image generation.
- [ShieldGemma: Generative AI Content Moderation Based on Gemma](https://www.ml-quant.com/papers/arxiv/2407.21772/): ShieldGemma is a safety content moderation model that excels in predicting safety risks such as explicit content and hate speech, surpassing models like LlamaGuard and WildCard.
