← Back to publications
2024 · Journal article · Published

MirrorDiffusion: Stabilizing Diffusion Process in Zero-shot Image Translation by Prompts Redescription and Beyond

Yupei Lin, Xiaoyu Xian, Yukai Shi, Liang Lin
IEEE Signal Processing Letters, 2024
Figure 1 — MirrorDiffusion: Stabilizing Diffusion Process in Zero-shot Image Translation by Prompts Redescription and Beyond
Fig. 1: Without any supervision, MirrorDiffusion realized three zero-shot image-to-image translations: w/o glasses →w/ glasses, Male →Female and Fox →Dog.
Overview

Introduces prompt redescription to align text prompts with latent codes during diffusion inversion, stabilizing structure-preserving zero-shot image translation.

Paper / Publisher ↗ PDF ↗ Code / Project ↗