Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Retrieval-Augmented Multimodal Model for Fake News Detection

sigir26-081 · Full research paper · Yiheng Li, Weihai Lu, Hanyi Yu, Yue Wang
Multimodal Fake News Detection · 50% Multimodal Evaluation and Benchmarks · 25% Multimodal Retrieval and Embedding · 25%
Abstract

In recent years, multi-modal multi-domain fake news detection has garnered increasing attention. Nevertheless, this direction presents two significant challenges: (1) Failure to Capture Cross-Instance Narrative Consistency: existing models usually evaluate each news in isolation, fail to capture cross-instance narrative consistency, and thus struggle to address the spread of cluster-based fake news driven by social media; (2) Lack of Domain-Specific Knowledge for Reasoning: conventional models, which rely solely on knowledge encoded in their parameters during training, struggle to generalize to new or data-scarce domains (e.g., emerging events or niche topics). To tackle these challenges, we introduce Retrieval-Augmented Multimodal Model for Fake News Detection (RAMM). First, RAMM employs a Multimodal Large Language Model (MLLM) as its backbone to capture cross-modal semantic information from news samples. Second, RAMM incorporates an Abstract Narrative Alignment Module. This component adaptively extracts abstract narrative consistency from diverse instances across distinct domains, aggregates relevant knowledge, and thereby enables the modeling of high-level narrative information. Finally, RAMM introduces a Semantic Representation Alignment Module, which aligns the model's decision-making paradigm with that of humans—specifically, it shifts the model's reasoning process from direct inference on multimodal features to an instance-based analogical reasoning process. Extensive experimental results on three public datasets validate the efficacy of our proposed approach. Our code is available at the following link: https://github.com/li-yiheng/RAMM

Assigned reviewers

#ReviewerMatchWhy (closest evidence publications in the taxonomy)
1 Jian Lang
73
61 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection
61 Nip Rumors in the Bud: Retrieval-Guided Topic-Level Adaptation for Test-Time Fake News Video Detection (2026) Multimodal Fake News Detection
61 Enhancing fake news video detection with self-driven question-answer from LMMs (2026) Multimodal Fake News Detection
2 Ruichao Yang
69
87 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection
87 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection
87 GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abuse (2026) Multimodal Fake News Detection
3 Zihan Ma 0001
60
61 Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection (2024) Multimodal Fake News Detection
61 IMOL: Incomplete-Modality-Tolerant Learning for Multi-Domain Fake News Video Detection (2025) Multimodal Fake News Detection
61 Each Fake News Is Fake in Its Own Way: An Attribution Multi-Granularity Benchmark for Multimodal Fake News Detection (2025) Multimodal Fake News Detection

Area chair

Area chairMatch
Yi R. Fung 0001 46
Area-chair candidates (5)
Yi R. Fung 0001 assigned 4610 papers
Hao Fei 0001 444 papers
Xiaoye Qu 4415 papers
Kam-Fai Wong 336 papers
Xun Yang 0001 314 papers

Candidates from the panel ranked by match score

#ReviewerMatchLoadWhy
1 Jian Lang assigned 73 3
61 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection
61 Nip Rumors in the Bud: Retrieval-Guided Topic-Level Adaptation for Test-Time Fake News Video Detection (2026) Multimodal Fake News Detection
2 Ruichao Yang assigned 69 3
87 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection
87 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection
3 Zihan Ma 0001 assigned 60 3
61 Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection (2024) Multimodal Fake News Detection
61 IMOL: Incomplete-Modality-Tolerant Learning for Multi-Domain Fake News Video Detection (2025) Multimodal Fake News Detection
4 Zhi Zeng 0001 59 3
61 Event-Radar: Event-driven Multi-View Learning for Multimodal Fake News Detection (2024) Multimodal Fake News Detection
61 Correcting the Bias: Mitigating Multimodal Inconsistency Contrastive Learning for Multimodal Fake News Detection (2023) Multimodal Fake News Detection
5 Huaiwen Zhang 55 3
61 Synergizing LLMs with Global Label Propagation for Multimodal Fake News Detection (2025) Multimodal Fake News Detection
61 Multimodal Disentangled Domain Adaption for Social Media Event Rumor Detection (2021) Multimodal Fake News Detection
6 Haiyang Xu 0001 55 3
51 Hallucination Augmented Contrastive Learning for Multimodal Large Language Model (2024) Multimodal Evaluation and Benchmarks
51 L-CLIPScore: A Lightweight Embedding-Based Captioning Metric for Evaluating and Training (2026) Multimodal Evaluation and Benchmarks
7 Bo Wang 0069 53 3
61 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection
61 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection
8 Mariano Barone 53 3
87 SynthMed: Generating and Detecting Multimodal Deepfakes for Healthcare Communication (2025) Multimodal Fake News Detection
51 AMICO: A Semantic and Multimodal Framework for AI-Assisted Clinical Reporting (2025) Multimodal Evaluation and Benchmarks
9 Zihao Yue 50 3
52 Movie101: A New Movie Understanding Benchmark (2023) Video and Temporal Understanding
52 OpenMMEgo: Enhancing Egocentric Understanding for LMMs with Open Weights and Data (2025) Video and Temporal Understanding
10 Minghui Fang 0002 48 3
47 Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
47 VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation (2025) Multimodal Retrieval and Embedding
14 Nancy F. Chen 43 3
51 Multimodal Dialogue State Tracking (2022) Conversational Search and Retrieval
51 Topic-Aware Pointer-Generator Networks for Summarizing Spoken Conversations (2019) Multimodal Evaluation and Benchmarks
15 Linchao Zhu 40 3
60 Attention as Selector: Unlocking VLM Attention for Long Document Page Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval
51 MoS2: Mixture of Scale and Shift Experts for Text-Only Video Captioning (2024) Multimodal Evaluation and Benchmarks
16 Yanzhao Zhang 40 3
51 An End-to-End Model for Photo-Sharing Multi-Modal Dialogue Generation (2025) Multimodal Evaluation and Benchmarks
47 Bridging Modalities: Improving Universal Multimodal Retrieval by Multimodal Large Language Models (2025) Universal Multimodal Embedding and MLLM Retrieval
17 Tingyu Song 38 3
60 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval
52 VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos (2025) Video and Temporal Understanding
18 Qingyi Si 38 3
51 Multimodal Table Understanding (2024) Multimodal Evaluation and Benchmarks
51 Towards Flexible Evaluation for Generative Visual Question Answering (2024) Multimodal Evaluation and Benchmarks
19 Haokun Wen 34 3
62 Differential-Perceptive and Retrieval-Augmented MLLM for Change Captioning (2024) Multimodal and Graph RAG
34 HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
20 Jinpeng Wang 0002 34 3
47 Imagine with Layout and Sketch: Enhancing Vision-Language Retrieval with Dual-Stream Multi-Modal Query Refinement (2026) Universal Multimodal Embedding and MLLM Retrieval
47 Suit the Remedy to the Retriever: Interpretable Query Optimization with Retriever Preference Alignment for Vision-Language Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval
21 Chen Zhao 0013 34 3
51 Are Multimodal LLMs Robust Against Adversarial Perturbations? RoMMath: A Systematic Evaluation on Multimodal Math Reasoning (2025) Multimodal Evaluation and Benchmarks
29 LimRank: Less is More for Reasoning-Intensive Information Reranking (2025) LLM-Based Reranking
22 Weipeng Chen 33 3
52 Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs (2025) Video and Temporal Understanding
51 AITQE: An Adaptive Image-Text Quality Enhancer for Scalable MLLM Pretraining (2026) Multimodal Evaluation and Benchmarks
23 Sheng-Chieh Lin 33 3
60 Unifying Multimodal Retrieval via Document Screenshot Embedding (2024) Universal Multimodal Embedding and MLLM Retrieval
47 Mm-Embed: Universal Multimodal Retrieval with Multimodal LLMS (2025) Universal Multimodal Embedding and MLLM Retrieval
24 Di Wu 0054 33 3
46 The Factuality Tax of Diversity-Intervened Text-to-Image Generation: Benchmark and Fact-Augmented Intervention (2024) Multimodal Evaluation and Benchmarks
36 VisRet: Visualization Improves Knowledge-Intensive Text-to-Image Retrieval (2026) Multimodal and Graph RAG
25 Archiki Prasad 33 3
47 How Accents Confound: Probing for Accent Information in End-to-End Speech Recognition Systems (2020) Multimodal Retrieval and Embedding
47 An Investigation of End-to-End Models for Robust Speech Recognition (2021) Multimodal Retrieval and Embedding
26 Junjie Zhou 0001 33 3
52 MLVU: Benchmarking Multi-task Long Video Understanding (2025) Video and Temporal Understanding
34 VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval
28 Liwei Wang 0009 32 3
34 Learning Deep Structure-Preserving Image-Text Embeddings (2016) Universal Multimodal Embedding and MLLM Retrieval
34 Improving Image-Sentence Embeddings Using Large Weakly Annotated Photo Collections (2014) Universal Multimodal Embedding and MLLM Retrieval
29 Idan Szpektor 32 3
51 Bridging the Visual Gap: Fine-Tuning Multimodal Models with Knowledge-Adapted Captions (2025) Multimodal Evaluation and Benchmarks
32 On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Method (2023) Conversational Search and Retrieval
31 Navve Wasserman 30 3
33 DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankers (2025) Universal Multimodal Embedding and MLLM Retrieval
33 REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark (2025) Universal Multimodal Embedding and MLLM Retrieval
32 Farima Fatahi Bayat 30 3
25 CompactIE: Compact Facts in Open Information Extraction (2022) Language Model Pre-training and Adaptation
20 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025) Automated Fact Checking and Claim Verification
33 Jianfeng Dong 30 3
36 Feature Re-Learning with Data Augmentation for Content-based Video Recommendation (2018) Universal Multimodal Embedding and MLLM Retrieval
35 Exploring Content-based Video Relevance for Video Click-Through Rate Prediction (2019) Universal Multimodal Embedding and MLLM Retrieval
34 Venktesh V 30 3
29 TagRec++: Hierarchical Label Aware Attention Network for Question Categorization (2024) Text Embedding and Representation Learning
29 TagRec: Automated Tagging of Questions with Hierarchical Learning Taxonomy (2021) Text Embedding and Representation Learning
35 Junchen Fu 30 3
51 Benchmarking Multimodal Large Language Models for missing modality completion in product catalogues (2026) Multimodal Evaluation and Benchmarks
31 Teach Me How to Denoise: A Universal Framework for Denoising Multi-modal Recommender Systems via Guided Calibration (2025) Multimodal Generative Recommendation