Taming diffusion model for exemplar-based image translation
摘要
Exemplar-based image translation involves converting semantic masks into photorealistic images that adopt the style of a given exemplar.However,most existing GAN-based translation methods fail to produce photorealistic results.In this study,we propose a new diffusion model-based approach for generating high-quality images that are semantically aligned with the input mask and resemble an exemplar in style.The proposed method trains a conditional denoising diffusion probabilistic model(DDPM)with a SPADE module to integrate the semantic map.We then used a novel contextual loss and auxiliary color loss to guide the optimization process,resulting in images that were visually pleasing and semantically accurate.Experiments demonstrate that our method outperforms state-of-the-art approaches in terms of both visual quality and quantitative metrics.
Author:
Hao Ma
Jingyuan Yang
Hui Huang
作者单位:
Visual Computing Research Center,College of Com-puter Science and Software Engineering,Shenzhen University,Shenzhen 518060,China
年,卷(期):
2024, 10(6)
机标分类号:
TQ0
TP311.52
TH137.52
在线出版日期:
2025年4月23日