Retrieval-Augmented Multimodal Model for Fake News Detection
Abstract
In recent years, multi-modal multi-domain fake news detection has garnered increasing attention. Nevertheless, this direction presents two significant challenges: (1) Failure to Capture Cross-Instance Narrative Consistency: existing models usually evaluate each news in isolation, fail to capture cross-instance narrative consistency, and thus struggle to address the spread of cluster-based fake news driven by social media; (2) Lack of Domain-Specific Knowledge for Reasoning: conventional models, which rely solely on knowledge encoded in their parameters during training, struggle to generalize to new or data-scarce domains (e.g., emerging events or niche topics). To tackle these challenges, we introduce Retrieval-Augmented Multimodal Model for Fake News Detection (RAMM). First, RAMM employs a Multimodal Large Language Model (MLLM) as its backbone to capture cross-modal semantic information from news samples. Second, RAMM incorporates an Abstract Narrative Alignment Module. This component adaptively extracts abstract narrative consistency from diverse instances across distinct domains, aggregates relevant knowledge, and thereby enables the modeling of high-level narrative information. Finally, RAMM introduces a Semantic Representation Alignment Module, which aligns the model's decision-making paradigm with that of humans—specifically, it shifts the model's reasoning process from direct inference on multimodal features to an instance-based analogical reasoning process. Extensive experimental results on three public datasets validate the efficacy of our proposed approach. Our code is available at the following link: https://github.com/li-yiheng/RAMM
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Jian Lang | 73 | 61 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection 61 Nip Rumors in the Bud: Retrieval-Guided Topic-Level Adaptation for Test-Time Fake News Video Detection (2026) Multimodal Fake News Detection 61 Enhancing fake news video detection with self-driven question-answer from LMMs (2026) Multimodal Fake News Detection |
|
| 2 | Ruichao Yang | 69 | 87 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection 87 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection 87 GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abuse (2026) Multimodal Fake News Detection |
|
| 3 | Zihan Ma 0001 | 60 | 61 Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection (2024) Multimodal Fake News Detection 61 IMOL: Incomplete-Modality-Tolerant Learning for Multi-Domain Fake News Video Detection (2025) Multimodal Fake News Detection 61 Each Fake News Is Fake in Its Own Way: An Attribution Multi-Granularity Benchmark for Multimodal Fake News Detection (2025) Multimodal Fake News Detection |
Area chair
| Area chair | Match | |
|---|---|---|
| Yi R. Fung 0001 | 46 |
Area-chair candidates (5)
| Yi R. Fung 0001 assigned | 46 | 10 papers | |
| Hao Fei 0001 | 44 | 4 papers | |
| Xiaoye Qu | 44 | 15 papers | |
| Kam-Fai Wong | 33 | 6 papers | |
| Xun Yang 0001 | 31 | 4 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Jian Lang assigned | 73 | 3 | 61 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection 61 Nip Rumors in the Bud: Retrieval-Guided Topic-Level Adaptation for Test-Time Fake News Video Detection (2026) Multimodal Fake News Detection |
|
| 2 | Ruichao Yang assigned | 69 | 3 | 87 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection 87 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection |
|
| 3 | Zihan Ma 0001 assigned | 60 | 3 | 61 Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection (2024) Multimodal Fake News Detection 61 IMOL: Incomplete-Modality-Tolerant Learning for Multi-Domain Fake News Video Detection (2025) Multimodal Fake News Detection |
|
| 4 | Zhi Zeng 0001 | 59 | 3 | 61 Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection (2024) Multimodal Fake News Detection 61 Correcting the Bias: Mitigating Multimodal Inconsistency Contrastive Learning for Multimodal Fake News Detection (2023) Multimodal Fake News Detection |
|
| 5 | Huaiwen Zhang | 55 | 3 | 61 Synergizing LLMs with Global Label Propagation for Multimodal Fake News Detection (2025) Multimodal Fake News Detection 61 Multimodal Disentangled Domain Adaption for Social Media Event Rumor Detection (2021) Multimodal Fake News Detection |
|
| 6 | Haiyang Xu 0001 | 55 | 3 | 51 Hallucination Augmented Contrastive Learning for Multimodal Large Language Model (2024) Multimodal Evaluation and Benchmarks 51 L-CLIPScore: A Lightweight Embedding-Based Captioning Metric for Evaluating and Training (2026) Multimodal Evaluation and Benchmarks |
|
| 7 | Bo Wang 0069 | 53 | 3 | 61 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection 61 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection |
|
| 8 | Mariano Barone | 53 | 3 | 87 SynthMed: Generating and Detecting Multimodal Deepfakes for Healthcare Communication (2025) Multimodal Fake News Detection 51 AMICO: A Semantic and Multimodal Framework for AI-Assisted Clinical Reporting (2025) Multimodal Evaluation and Benchmarks |
|
| 9 | Zihao Yue | 50 | 3 | 52 Movie101: A New Movie Understanding Benchmark (2023) Video and Temporal Understanding 52 OpenMMEgo: Enhancing Egocentric Understanding for LMMs with Open Weights and Data (2025) Video and Temporal Understanding |
|
| 10 | Minghui Fang 0002 | 48 | 3 | 47 Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval 47 VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation (2025) Multimodal Retrieval and Embedding |
|
| 14 | Nancy F. Chen | 43 | 3 | 51 Multimodal Dialogue State Tracking (2022) Conversational Search and Retrieval 51 Topic-Aware Pointer-Generator Networks for Summarizing Spoken Conversations (2019) Multimodal Evaluation and Benchmarks |
|
| 15 | Linchao Zhu | 40 | 3 | 60 Attention as Selector: Unlocking VLM Attention for Long Document Page Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval 51 MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning (2024) Multimodal Evaluation and Benchmarks |
|
| 16 | Yanzhao Zhang | 40 | 3 | 51 An End-to-End Model for Photo-Sharing Multi-Modal Dialogue Generation (2025) Multimodal Evaluation and Benchmarks 47 Bridging Modalities: Improving Universal Multimodal Retrieval by Multimodal Large Language Models (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 17 | Tingyu Song | 38 | 3 | 60 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval 52 VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos (2025) Video and Temporal Understanding |
|
| 18 | Qingyi Si | 38 | 3 | 51 Multimodal Table Understanding (2024) Multimodal Evaluation and Benchmarks 51 Towards Flexible Evaluation for Generative Visual Question Answering (2024) Multimodal Evaluation and Benchmarks |
|
| 19 | Haokun Wen | 34 | 3 | 62 Differential-Perceptive and Retrieval-Augmented MLLM for Change Captioning (2024) Multimodal and Graph RAG 34 HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 20 | Jinpeng Wang 0002 | 34 | 3 | 47 Imagine with Layout and Sketch: Enhancing Vision-Language Retrieval with Dual-Stream Multi-Modal Query Refinement (2026) Universal Multimodal Embedding and MLLM Retrieval 47 Suit the Remedy to the Retriever: Interpretable Query Optimization with Retriever Preference Alignment for Vision-Language Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval |
|
| 21 | Chen Zhao 0013 | 34 | 3 | 51 Are Multimodal LLMs Robust Against Adversarial Perturbations? RoMMath: A Systematic Evaluation on Multimodal Math Reasoning (2025) Multimodal Evaluation and Benchmarks 29 LimRank: Less is More for Reasoning-Intensive Information Reranking (2025) LLM-Based Reranking |
|
| 22 | Weipeng Chen | 33 | 3 | 52 Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs (2025) Video and Temporal Understanding 51 AITQE: An Adaptive Image-Text Quality Enhancer for Scalable MLLM Pretraining (2026) Multimodal Evaluation and Benchmarks |
|
| 23 | Sheng-Chieh Lin | 33 | 3 | 60 Unifying Multimodal Retrieval via Document Screenshot Embedding (2024) Universal Multimodal Embedding and MLLM Retrieval 47 Mm-Embed: Universal Multimodal Retrieval with Multimodal LLMS (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 24 | Di Wu 0054 | 33 | 3 | 46 The Factuality Tax of Diversity-Intervened Text-to-Image Generation: Benchmark and Fact-Augmented Intervention (2024) Multimodal Evaluation and Benchmarks 36 VisRet: Visualization Improves Knowledge-Intensive Text-to-Image Retrieval (2026) Multimodal and Graph RAG |
|
| 25 | Archiki Prasad | 33 | 3 | 47 How Accents Confound: Probing for Accent Information in End-to-End Speech Recognition Systems (2020) Multimodal Retrieval and Embedding 47 An Investigation of End-to-End Models for Robust Speech Recognition (2021) Multimodal Retrieval and Embedding |
|
| 26 | Junjie Zhou 0001 | 33 | 3 | 52 MLVU: Benchmarking Multi-task Long Video Understanding (2025) Video and Temporal Understanding 34 VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval |
|
| 28 | Liwei Wang 0009 | 32 | 3 | 34 Learning Deep Structure-Preserving Image-Text Embeddings (2016) Universal Multimodal Embedding and MLLM Retrieval 34 Improving Image-Sentence Embeddings Using Large Weakly Annotated Photo Collections (2014) Universal Multimodal Embedding and MLLM Retrieval |
|
| 29 | Idan Szpektor | 32 | 3 | 51 Bridging the Visual Gap: Fine-Tuning Multimodal Models with Knowledge-Adapted Captions (2025) Multimodal Evaluation and Benchmarks 32 On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Method (2023) Conversational Search and Retrieval |
|
| 31 | Navve Wasserman | 30 | 3 | 33 DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankers (2025) Universal Multimodal Embedding and MLLM Retrieval 33 REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 32 | Farima Fatahi Bayat | 30 | 3 | 25 CompactIE: Compact Facts in Open Information Extraction (2022) Language Model Pre-training and Adaptation 20 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025) Automated Fact Checking and Claim Verification |
|
| 33 | Jianfeng Dong | 30 | 3 | 36 Feature Re-Learning with Data Augmentation for Content-based Video Recommendation (2018) Universal Multimodal Embedding and MLLM Retrieval 35 Exploring Content-based Video Relevance for Video Click-Through Rate Prediction (2019) Universal Multimodal Embedding and MLLM Retrieval |
|
| 34 | Venktesh V | 30 | 3 | 29 TagRec++: Hierarchical Label Aware Attention Network for Question Categorization (2024) Text Embedding and Representation Learning 29 TagRec: Automated Tagging of Questions with Hierarchical Learning Taxonomy (2021) Text Embedding and Representation Learning |
|
| 35 | Junchen Fu | 30 | 3 | 51 Benchmarking Multimodal Large Language Models for missing modality completion in product catalogues (2026) Multimodal Evaluation and Benchmarks 31 Teach Me How to Denoise: A Universal Framework for Denoising Multi-modal Recommender Systems via Guided Calibration (2025) Multimodal Generative Recommendation |