TY - GEN
T1 - Negotiating the Punchline
T2 - 49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026
AU - Wang, Bingbing
AU - Wang, Zihan
AU - Jin, Zhengda
AU - Li, Jing
AU - Xu, Ruifeng
AU - Zhang, Min
N1 - Publisher Copyright:
© 2026 Owner/Author.
PY - 2026/7/19
Y1 - 2026/7/19
N2 - Contextual meme understanding decodes implicit meaning from ambiguous visual metaphors and social context, which is crucial for online communication analysis. However, existing linear reasoning paradigms reductively cast this process as deterministic decoding, overlooking the fundamental reality that meme interpretation necessitates the dynamic alignment of multimodal cues. Lacking mechanisms to measure and correct misalignment, these static models inevitably allow initial perceptual failures to cascade into irreversible hallucinations. To address this, we propose Semantic Energy Entropy Descent (SEED), a framework that reformulates contextual meme understanding as an energy minimization problem within a discrete semantic space. Specifically, SEED constructs a Convergent Heterogeneous Thought Tree (CHTT) as the optimization workspace, where an Evaluator Agent quantifies the semantic inconsistency of hypotheses via a Semantic Energy Mechanism. By calculating a Discrete Semantic Gradient as structured feedback, the framework activates a Supplier Agent to retrieve knowledge and context evidence and a Reasoner Agent to refine explanations, thereby orchestrating Semantic Descent Dynamics that iteratively drive the reasoning trajectory to converge on a stable, low-entropy interpretation. Experimental results show that SEED consistently outperforms strong baselines on both classification and generation, reducing logical hallucinations and improving cultural grounding.
AB - Contextual meme understanding decodes implicit meaning from ambiguous visual metaphors and social context, which is crucial for online communication analysis. However, existing linear reasoning paradigms reductively cast this process as deterministic decoding, overlooking the fundamental reality that meme interpretation necessitates the dynamic alignment of multimodal cues. Lacking mechanisms to measure and correct misalignment, these static models inevitably allow initial perceptual failures to cascade into irreversible hallucinations. To address this, we propose Semantic Energy Entropy Descent (SEED), a framework that reformulates contextual meme understanding as an energy minimization problem within a discrete semantic space. Specifically, SEED constructs a Convergent Heterogeneous Thought Tree (CHTT) as the optimization workspace, where an Evaluator Agent quantifies the semantic inconsistency of hypotheses via a Semantic Energy Mechanism. By calculating a Discrete Semantic Gradient as structured feedback, the framework activates a Supplier Agent to retrieve knowledge and context evidence and a Reasoner Agent to refine explanations, thereby orchestrating Semantic Descent Dynamics that iteratively drive the reasoning trajectory to converge on a stable, low-entropy interpretation. Experimental results show that SEED consistently outperforms strong baselines on both classification and generation, reducing logical hallucinations and improving cultural grounding.
KW - heterogeneousthought tree
KW - meme understanding
KW - semantic energy mechanism
UR - https://www.scopus.com/pages/publications/105047271967
U2 - 10.1145/3805712.3809880
DO - 10.1145/3805712.3809880
M3 - 会议稿件
AN - SCOPUS:105047271967
T3 - SIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval
SP - 4256
EP - 4260
BT - SIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval
PB - Association for Computing Machinery, Inc
Y2 - 20 July 2026 through 24 July 2026
ER -