Skip to main navigation Skip to search Skip to main content

RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checking

  • Shuo Yang*
  • , Zijian Yu
  • , Zhenzhe Ying
  • , Yuqin Dai
  • , Guoqing Wang
  • , Jun Lan
  • , Jinfeng Xu
  • , Jinze Li
  • , Edith C.H. Ngai
  • *Corresponding author for this work
  • The University of Hong Kong
  • Ant Group

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The rapid proliferation of multimodal misinformation presents significant challenges for automated fact-checking systems, especially when claims are ambiguous or lack sufficient context. We introduce RAMA, a novel retrieval-augmented multi-agent framework designed for verifying multimedia misinformation. RAMA incorporates three core innovations: (1) strategic query formulation that transforms multimodal claims into precise web search queries; (2) cross-verification evidence aggregation from diverse, authoritative sources; and (3) a multi-agent ensemble architecture that leverages the complementary strengths of multiple multimodal large language models and prompt variants. Extensive experiments demonstrate that RAMA achieves superior performance on benchmark datasets, particularly excelling in resolving ambiguous or improbable claims by grounding verification in retrieved factual evidence. Our findings underscore the necessity of integrating web-based evidence and multi-agent reasoning for trustworthy multimedia verification, paving the way for more reliable and scalable fact-checking solutions. RAMA is already publicly available at \href https://github.com/kalendsyang/RAMA.

Original languageEnglish
Title of host publicationWWW Companion 2026 - Companion Proceedings of the ACM Web Conference 2026
PublisherAssociation for Computing Machinery, Inc
Pages416-424
Number of pages9
ISBN (Electronic)9798400723087
DOIs
StatePublished - 28 May 2026
Externally publishedYes
Event35th ACM Web Conference, WWW Companion 2026 - Dubai, United Arab Emirates
Duration: 29 Jun 20263 Jul 2026

Publication series

NameWWW Companion 2026 - Companion Proceedings of the ACM Web Conference 2026

Conference

Conference35th ACM Web Conference, WWW Companion 2026
Country/TerritoryUnited Arab Emirates
CityDubai
Period29/06/263/07/26

Keywords

  • fact-checking
  • llm agents
  • misinformation detection
  • multimedia verification
  • multimodal large language models

Fingerprint

Dive into the research topics of 'RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checking'. Together they form a unique fingerprint.

Cite this