Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videos

sigir26-113 · Full research paper · Junyu Lu, Deyi Ji, Liqun Liu, Xiaokun Zhang, Youlin Wu, Roy Ka-Wei Lee, Peng Shu, Huan Yu, Jie Jiang, Bo Xu, Liang Yang, Hongfei Lin
Multimodal Fake News Detection · 50% Video and Temporal Understanding · 25% Multimodal Evaluation and Benchmarks · 25%
Abstract

Hateful videos have become prevalent on online platforms, highlighting an urgent need for effective detection. However, existing studies primarily focus on binary classification and fail to provide contextual rationales that reveal the implicit meanings behind these judgments, significantly undermining model explainability. To fill this gap, we aim to achieve explainable hateful video detection, enabling models to provide contextual rationales that integrate relevant evidence and logical reasoning alongside decisions. This approach can comprehensively enhance the understanding of video content and the explainability of the decision-making process. We first introduce two datasets, Ex-HateMM and Ex-ImpliHateVid, for explainable hateful video detection. Each dataset provides fine-grained annotations of multimodal harmful elements, along with contextual rationales. We then propose an Information Augmentation and Reasoning Enhancement (IARE) framework designed for explainable detection. The framework employs an information augmentation phase that leverages the multimodal chain-of-thought to integrate harmful elements, thereby enriching rationale evidence. Additionally, IARE incorporates a reasoning enhancement phase, in which Direct Preference Optimization guides the model toward correct reasoning paths and away from incorrect ones, thereby improving the logical coherence of its justifications. We conduct extensive experiments on the two datasets, comparing multiple baselines with our proposed IARE framework. The results demonstrate that IARE achieves state-of-the-art performance while also generating accurate rationales.

Assigned reviewers

#ReviewerMatchWhy (closest evidence publications in the taxonomy)
1 Ruichao Yang
74
84 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection
84 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection
84 GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abuse (2026) Multimodal Fake News Detection
2 Jian Lang
66
64 Biting Off More Than You Can Detect: Retrieval-Augmented Multimodal Experts for Short Video Hate Detection (2025) Multimodal Fake News Detection
64 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection
64 Enhancing fake news video detection with self-driven question-answer from LMMs (2026) Multimodal Fake News Detection
3 Zhi Zeng 0001
63
64 From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild (2026) Multimodal Fake News Detection
64 Understand, Refine and Summarize: Multi-View Knowledge Progressive Enhancement Learning for Fake News Video Detection (2025) Multimodal Fake News Detection
64 Mitigating World Biases: A Multimodal Multi-View Debiasing Framework for Fake News Video Detection (2024) Multimodal Fake News Detection

Area chair

Area chairMatch
Yi R. Fung 0001 48
Area-chair candidates (5)
Yi R. Fung 0001 assigned 4810 papers
Xiaoye Qu 4215 papers
Hao Fei 0001 424 papers
Kam-Fai Wong 336 papers
Xun Yang 0001 334 papers

Candidates from the panel ranked by match score

#ReviewerMatchLoadWhy
1 Ruichao Yang assigned 74 3
84 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection
84 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection
2 Jian Lang assigned 66 3
64 Biting Off More Than You Can Detect: Retrieval-Augmented Multimodal Experts for Short Video Hate Detection (2025) Multimodal Fake News Detection
64 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection
3 Zhi Zeng 0001 assigned 63 3
64 From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild (2026) Multimodal Fake News Detection
64 Understand, Refine and Summarize: Multi-View Knowledge Progressive Enhancement Learning for Fake News Video Detection (2025) Multimodal Fake News Detection
4 Zihan Ma 0001 63 3
64 From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild (2026) Multimodal Fake News Detection
64 Understand, Refine and Summarize: Multi-View Knowledge Progressive Enhancement Learning for Fake News Video Detection (2025) Multimodal Fake News Detection
5 Zihao Yue 59 3
64 Movie101v2: Improved Movie Narration Benchmark (2025) Video and Temporal Understanding
64 Movie101: A New Movie Understanding Benchmark (2023) Video and Temporal Understanding
6 Huaiwen Zhang 57 3
64 Synergizing LLMs with Global Label Propagation for Multimodal Fake News Detection (2025) Multimodal Fake News Detection
64 Multi-modal Knowledge-aware Event Memory Network for Social Media Rumor Detection (2019) Multimodal Fake News Detection
7 Bo Wang 0069 55 3
64 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection
64 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection
8 Linchao Zhu 52 3
48 Uncovering the Temporal Context for Video Question Answering (2017) Video and Temporal Understanding
48 From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-Reward Alignment (2025) Video and Temporal Understanding
9 Mariano Barone 51 3
84 SynthMed: Generating and Detecting Multimodal Deepfakes for Healthcare Communication (2025) Multimodal Fake News Detection
47 AMICO: A Semantic and Multimodal Framework for AI-Assisted Clinical Reporting (2025) Multimodal Evaluation and Benchmarks
10 Haiyang Xu 0001 50 3
48 mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models (2025) Video and Temporal Understanding
47 Hallucination Augmented Contrastive Learning for Multimodal Large Language Model (2024) Multimodal Evaluation and Benchmarks
14 Tingyu Song 40 3
64 VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos (2025) Video and Temporal Understanding
44 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval
15 Nancy F. Chen COI: co-author 40 3
49 Multimodal Dialogue State Tracking (2022) Conversational Search and Retrieval
47 Controllable Neural Dialogue Summarization with Personal Named Entity Planning (2021) Multimodal Evaluation and Benchmarks
16 Junjie Zhou 0001 40 3
64 MLVU: Benchmarking Multi-task Long Video Understanding (2025) Video and Temporal Understanding
48 Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understanding (2025) Video and Temporal Understanding
17 Qingyi Si 37 3
47 Multimodal Table Understanding (2024) Multimodal Evaluation and Benchmarks
47 Towards Flexible Evaluation for Generative Visual Question Answering (2024) Multimodal Evaluation and Benchmarks
18 Weipeng Chen 33 3
64 Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs (2025) Video and Temporal Understanding
47 AITQE: An Adaptive Image-Text Quality Enhancer for Scalable MLLM Pretraining (2026) Multimodal Evaluation and Benchmarks
21 Chen Zhao 0013 33 3
47 Are Multimodal LLMs Robust Against Adversarial Perturbations? RoMMath: A Systematic Evaluation on Multimodal Math Reasoning (2025) Multimodal Evaluation and Benchmarks
29 LimRank: Less is More for Reasoning-Intensive Information Reranking (2025) LLM-Based Reranking
22 Liwei Wang 0009 32 3
48 AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning (2025) Video and Temporal Understanding
35 RAST: Domain-Robust Dialogue Rewriting as Sequence Tagging (2021) Conversational Search and Retrieval
23 Jianfeng Dong 32 3
36 IVCR-200K: A Large-Scale Multi-turn Dialogue Benchmark for Interactive Video Corpus Retrieval (2025) Conversational Search and Retrieval
35 Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval using Language (2024) Video and Moment Retrieval
24 Minghui Fang 0002 32 3
31 Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
31 ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control (2025) Multimodal Retrieval and Embedding
25 Yanzhao Zhang 32 3
47 An End-to-End Model for Photo-Sharing Multi-Modal Dialogue Generation (2025) Multimodal Evaluation and Benchmarks
31 Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs (2025) Universal Multimodal Embedding and MLLM Retrieval
26 Farima Fatahi Bayat 32 3
25 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025) Automated Fact Checking and Claim Verification
25 Enhancing Language Model Factuality via Activation-Based Confidence Calibration and Guided Decoding (2024) Automated Fact Checking and Claim Verification
27 Idan Szpektor 31 3
47 Bridging the Visual Gap: Fine-Tuning Multimodal Models with Knowledge-Adapted Captions (2025) Multimodal Evaluation and Benchmarks
30 On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Method (2023) Conversational Search and Retrieval
28 Di Wu 0054 31 3
43 The Factuality Tax of Diversity-Intervened Text-to-Image Generation: Benchmark and Fact-Augmented Intervention (2024) Multimodal Evaluation and Benchmarks
32 VisRet: Visualization Improves Knowledge-Intensive Text-to-Image Retrieval (2026) Multimodal and Graph RAG
29 Qisheng Hu 30 3
27 Coordinating Search-Informed Reasoning and Reasoning-Guided Search in Claim Verification (2026) Automated Fact Checking and Claim Verification
25 Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance? (2025) Automated Fact Checking and Claim Verification
30 Qinggang Zhang 30 3
47 Augmenting Intra-Modal Understanding in MLLMs for Robust Multimodal Keyphrase Generation (2026) Multimodal Evaluation and Benchmarks
33 Facilitating Generative Retrieval with Logical Denoising for Interpretable Conversational Search (2026) Personalized and Conversational RAG
31 Jinpeng Wang 0002 30 3
35 Enhancing Partially Relevant Video Retrieval with Hyperbolic Learning (2025) Video and Moment Retrieval
31 Suit the Remedy to the Retriever: Interpretable Query Optimization with Retriever Preference Alignment for Vision-Language Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval
32 Sheng-Chieh Lin 30 3
44 Unifying Multimodal Retrieval via Document Screenshot Embedding (2024) Universal Multimodal Embedding and MLLM Retrieval
33 Chatty Goose: A Python Framework for Conversational Search (2021) Conversational Search and Retrieval
33 Yu-An Liu 0028 29 3
31 On the Robustness of Generative Information Retrieval Models: An Out-of-Distribution Perspective (2025) Generative Retrieval
29 Black-box Adversarial Attacks against Dense Retrieval Models: A Multi-view Contrastive Learning Method (2023) Robustness and Adversarial IR
34 Haokun Wen 29 3
46 Differential-Perceptive and Retrieval-Augmented MLLM for Change Captioning (2024) Multimodal and Graph RAG
28 ENCODER: Entity Mining and Modification Relation Binding for Composed Image Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
35 Navve Wasserman 29 3
30 DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankers (2025) Universal Multimodal Embedding and MLLM Retrieval
30 REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark (2025) Universal Multimodal Embedding and MLLM Retrieval