Skip to main navigation Skip to search Skip to main content

Minimising Distortion for GAN-Based Facial Attribute Manipulation

  • Mingyu Shao
  • , Li Lu
  • , Ye Ding*
  • , Qing Liao
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Facial Attribute Manipulation (FAM) through GAN-based methods has been an active topic in computer graphics. Existing works show high editing fidelity on randomly generated faces but suffer from distortion on embedded real faces. We alleviate this issue by dividing it into two sub-problems. First, we minimize embedding distortion by introducing a pre-trained Salient Object Detection (SOD) network. Second, we propose a nonlinear transformation network to minimize editing distortion. As a result, our framework, Character Centered Facial Attribute Manipulation (CCFAM), exhibits more disentangled edits on real faces. Moreover, CCFAM is computationally efficient by integrating image complexity into our embedding process. Evaluations demonstrate that our method performs better than the state-of-the-art in terms of both accuracy and fidelity.

Original languageEnglish
Title of host publicationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728163277
DOIs
StatePublished - 2023
Externally publishedYes
Event48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023 - Rhodes Island, Greece
Duration: 4 Jun 202310 Jun 2023

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Volume2023-June
ISSN (Print)1520-6149

Conference

Conference48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023
Country/TerritoryGreece
CityRhodes Island
Period4/06/2310/06/23

Keywords

  • Facial Attribute Manipulation
  • GAN
  • Salient Object Detection

Fingerprint

Dive into the research topics of 'Minimising Distortion for GAN-Based Facial Attribute Manipulation'. Together they form a unique fingerprint.

Cite this