Skip to main navigation Skip to search Skip to main content

Multi-scale architectures matter: Examining the adversarial robustness of flow-based lossless compression

  • Yichong Xia
  • , Bin Chen*
  • , Yan Feng
  • , Tianshuo Ge
  • , Yujun Huang
  • , Haoqian Wang
  • , Yaowei Wang
  • *Corresponding author for this work
  • Tsinghua University
  • The Chinese University of Hong Kong, Shenzhen
  • Peng Cheng Laboratory
  • Harbin Institute of Technology Shenzhen
  • Meituan

Research output: Contribution to journalArticlepeer-review

Abstract

Exact likelihood estimation on entropy coding makes flow-based models appealing for lossless image compression. However, the high fidelity storage cost is affected by the lossless compression ratio. The trade-off between efficiency and robustness of flow-based deep lossless compression models has not been fully explored. This paper characterizes the trade-off theoretically and empirically, revealing that flow-based models are susceptible to adversarial examples resulting in a significant change in compression ratio. The fragile robustness of flow-based models is due to their intrinsic multi-scale architectures lacking the Lipschitz property. Based on this insight, a stronger white-box attack, Auto-Weighted Projected Gradient Descent (AW-PGD), is developed to generate more universal adversarial examples. Additionally, a novel flow-based lossless compression model, Robust Integer Discrete Flow (R-IDF), is proposed to achieve comparable robustness to adversarial training without sacrificing compression efficiency. Experiments demonstrate that the PGD algorithm falls into local extreme values when attacking the compression model, but the proposed attack and defense methods effectively improve the invulnerability of the flow-based compression model.

Original languageEnglish
Article number110242
JournalPattern Recognition
Volume149
DOIs
StatePublished - May 2024
Externally publishedYes

Keywords

  • Adversarial attack
  • Flow models
  • Lipschitz property
  • Lossless compression

Fingerprint

Dive into the research topics of 'Multi-scale architectures matter: Examining the adversarial robustness of flow-based lossless compression'. Together they form a unique fingerprint.

Cite this