Skip to main navigation Skip to search Skip to main content

Once-for-all: Efficient Visual Face Privacy Protection via Person-specific Veils

  • Zixuan Yang
  • , Yushu Zhang*
  • , Tao Wang
  • , Zhongyun Hua
  • , Zhihua Xia
  • , Jian Weng
  • *Corresponding author for this work
  • Nanjing University of Aeronautics and Astronautics
  • Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies
  • Harbin Institute of Technology Shenzhen
  • Jinan University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

As billions of face images stored on cloud platforms contain sensitive information to human vision, the public confronts substantial threats to visual face privacy. In response, the community has proposed some perturbation-based schemes to mitigate visual privacy leakage. However, these schemes need to generate a new protective perturbation for each image, failing to satisfy the real-time requirement of cloud platforms. To address this issue, we present an efficient visual face privacy protection scheme by utilizing person-specific veils, which can be conveniently applied to all images of the same user without regeneration. The protected images exhibit significant visual differences from the originals but remain identifiable to face recognition models. Furthermore, the protected images can be recovered to originals under certain circumstances. In the process of generating the veils, we propose a feature alignment loss to promote consistency between the recognition outputs of protected and original images with approximate construction of feature subspace. Meanwhile, the block variance loss is designed to enhance the concealment of visual identity information. Extensive experimental results demonstrate that our scheme can significantly eliminate the visual appearance of original images and almost has no impact on face recognition models.

Original languageEnglish
Title of host publicationMM 2024 - Proceedings of the 32nd ACM International Conference on Multimedia
PublisherAssociation for Computing Machinery, Inc
Pages7705-7713
Number of pages9
ISBN (Electronic)9798400706868
DOIs
StatePublished - 28 Oct 2024
Externally publishedYes
Event32nd ACM International Conference on Multimedia, MM 2024 - Melbourne, Australia
Duration: 28 Oct 20241 Nov 2024

Publication series

NameMM 2024 - Proceedings of the 32nd ACM International Conference on Multimedia

Conference

Conference32nd ACM International Conference on Multimedia, MM 2024
Country/TerritoryAustralia
CityMelbourne
Period28/10/241/11/24

Keywords

  • adversarial perturbation
  • cloud platforms
  • face recognition
  • feature subspace
  • visual face privacy

Fingerprint

Dive into the research topics of 'Once-for-all: Efficient Visual Face Privacy Protection via Person-specific Veils'. Together they form a unique fingerprint.

Cite this