Skip to main navigation Skip to search Skip to main content

Negotiating the Punchline: Contextual Meme Understanding via Discrete Semantic Energy Minimization

  • Bingbing Wang
  • , Zihan Wang*
  • , Zhengda Jin
  • , Jing Li
  • , Ruifeng Xu*
  • , Min Zhang
  • *Corresponding author for this work
  • Harbin Institute of Technology Shenzhen
  • Hong Kong Polytechnic University
  • Shenzhen Loop Area Institute
  • Pengcheng Laboratory

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Contextual meme understanding decodes implicit meaning from ambiguous visual metaphors and social context, which is crucial for online communication analysis. However, existing linear reasoning paradigms reductively cast this process as deterministic decoding, overlooking the fundamental reality that meme interpretation necessitates the dynamic alignment of multimodal cues. Lacking mechanisms to measure and correct misalignment, these static models inevitably allow initial perceptual failures to cascade into irreversible hallucinations. To address this, we propose Semantic Energy Entropy Descent (SEED), a framework that reformulates contextual meme understanding as an energy minimization problem within a discrete semantic space. Specifically, SEED constructs a Convergent Heterogeneous Thought Tree (CHTT) as the optimization workspace, where an Evaluator Agent quantifies the semantic inconsistency of hypotheses via a Semantic Energy Mechanism. By calculating a Discrete Semantic Gradient as structured feedback, the framework activates a Supplier Agent to retrieve knowledge and context evidence and a Reasoner Agent to refine explanations, thereby orchestrating Semantic Descent Dynamics that iteratively drive the reasoning trajectory to converge on a stable, low-entropy interpretation. Experimental results show that SEED consistently outperforms strong baselines on both classification and generation, reducing logical hallucinations and improving cultural grounding.

Original languageEnglish
Title of host publicationSIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval
PublisherAssociation for Computing Machinery, Inc
Pages4256-4260
Number of pages5
ISBN (Electronic)9798400725999
DOIs
StatePublished - 19 Jul 2026
Externally publishedYes
Event49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026 - Melbourne, Australia
Duration: 20 Jul 202624 Jul 2026

Publication series

NameSIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval

Conference

Conference49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026
Country/TerritoryAustralia
CityMelbourne
Period20/07/2624/07/26

Keywords

  • heterogeneousthought tree
  • meme understanding
  • semantic energy mechanism

Fingerprint

Dive into the research topics of 'Negotiating the Punchline: Contextual Meme Understanding via Discrete Semantic Energy Minimization'. Together they form a unique fingerprint.

Cite this