Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videos
Abstract
Hateful videos have become prevalent on online platforms, highlighting an urgent need for effective detection. However, existing studies primarily focus on binary classification and fail to provide contextual rationales that reveal the implicit meanings behind these judgments, significantly undermining model explainability. To fill this gap, we aim to achieve explainable hateful video detection, enabling models to provide contextual rationales that integrate relevant evidence and logical reasoning alongside decisions. This approach can comprehensively enhance the understanding of video content and the explainability of the decision-making process. We first introduce two datasets, Ex-HateMM and Ex-ImpliHateVid, for explainable hateful video detection. Each dataset provides fine-grained annotations of multimodal harmful elements, along with contextual rationales. We then propose an Information Augmentation and Reasoning Enhancement (IARE) framework designed for explainable detection. The framework employs an information augmentation phase that leverages the multimodal chain-of-thought to integrate harmful elements, thereby enriching rationale evidence. Additionally, IARE incorporates a reasoning enhancement phase, in which Direct Preference Optimization guides the model toward correct reasoning paths and away from incorrect ones, thereby improving the logical coherence of its justifications. We conduct extensive experiments on the two datasets, comparing multiple baselines with our proposed IARE framework. The results demonstrate that IARE achieves state-of-the-art performance while also generating accurate rationales.
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Ruichao Yang | 74 | 84 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection 84 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection 84 GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social Abuse (2026) Multimodal Fake News Detection |
|
| 2 | Jian Lang | 66 | 64 Biting Off More Than You Can Detect: Retrieval-Augmented Multimodal Experts for Short Video Hate Detection (2025) Multimodal Fake News Detection 64 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection 64 Enhancing fake news video detection with self-driven question-answer from LMMs (2026) Multimodal Fake News Detection |
|
| 3 | Zhi Zeng 0001 | 63 | 64 From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild (2026) Multimodal Fake News Detection 64 Understand, Refine and Summarize: Multi-View Knowledge Progressive Enhancement Learning for Fake News Video Detection (2025) Multimodal Fake News Detection 64 Mitigating World Biases: A Multimodal Multi-View Debiasing Framework for Fake News Video Detection (2024) Multimodal Fake News Detection |
Area chair
| Area chair | Match | |
|---|---|---|
| Yi R. Fung 0001 | 48 |
Area-chair candidates (5)
| Yi R. Fung 0001 assigned | 48 | 10 papers | |
| Xiaoye Qu | 42 | 15 papers | |
| Hao Fei 0001 | 42 | 4 papers | |
| Kam-Fai Wong | 33 | 6 papers | |
| Xun Yang 0001 | 33 | 4 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Ruichao Yang assigned | 74 | 3 | 84 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection 84 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection |
|
| 2 | Jian Lang assigned | 66 | 3 | 64 Biting Off More Than You Can Detect: Retrieval-Augmented Multimodal Experts for Short Video Hate Detection (2025) Multimodal Fake News Detection 64 REAL: Retrieval-Augmented Prototype Alignment for Improved Fake News Video Detection (2025) Multimodal Fake News Detection |
|
| 3 | Zhi Zeng 0001 assigned | 63 | 3 | 64 From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild (2026) Multimodal Fake News Detection 64 Understand, Refine and Summarize: Multi-View Knowledge Progressive Enhancement Learning for Fake News Video Detection (2025) Multimodal Fake News Detection |
|
| 4 | Zihan Ma 0001 | 63 | 3 | 64 From Manipulation to Mistrust: Explaining Diverse Micro-Video Misinformation for Robust Debunking in the Wild (2026) Multimodal Fake News Detection 64 Understand, Refine and Summarize: Multi-View Knowledge Progressive Enhancement Learning for Fake News Video Detection (2025) Multimodal Fake News Detection |
|
| 5 | Zihao Yue | 59 | 3 | 64 Movie101v2: Improved Movie Narration Benchmark (2025) Video and Temporal Understanding 64 Movie101: A New Movie Understanding Benchmark (2023) Video and Temporal Understanding |
|
| 6 | Huaiwen Zhang | 57 | 3 | 64 Synergizing LLMs with Global Label Propagation for Multimodal Fake News Detection (2025) Multimodal Fake News Detection 64 Multi-modal Knowledge-aware Event Memory Network for Social Media Rumor Detection (2019) Multimodal Fake News Detection |
|
| 7 | Bo Wang 0069 | 55 | 3 | 64 ExplainHM++: Explainable Harmful Meme Detection With Retrieval-Augmented Debate Between Large Multimodal Models (2026) Multimodal Fake News Detection 64 Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models (2024) Multimodal Fake News Detection |
|
| 8 | Linchao Zhu | 52 | 3 | 48 Uncovering the Temporal Context for Video Question Answering (2017) Video and Temporal Understanding 48 From Trial to Triumph: Advancing Long Video Understanding via Visual Context Sample Scaling and Self-Reward Alignment (2025) Video and Temporal Understanding |
|
| 9 | Mariano Barone | 51 | 3 | 84 SynthMed: Generating and Detecting Multimodal Deepfakes for Healthcare Communication (2025) Multimodal Fake News Detection 47 AMICO: A Semantic and Multimodal Framework for AI-Assisted Clinical Reporting (2025) Multimodal Evaluation and Benchmarks |
|
| 10 | Haiyang Xu 0001 | 50 | 3 | 48 mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models (2025) Video and Temporal Understanding 47 Hallucination Augmented Contrastive Learning for Multimodal Large Language Model (2024) Multimodal Evaluation and Benchmarks |
|
| 14 | Tingyu Song | 40 | 3 | 64 VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos (2025) Video and Temporal Understanding 44 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval |
|
| 15 | Nancy F. Chen COI: co-author | 40 | 3 | 49 Multimodal Dialogue State Tracking (2022) Conversational Search and Retrieval 47 Controllable Neural Dialogue Summarization with Personal Named Entity Planning (2021) Multimodal Evaluation and Benchmarks |
|
| 16 | Junjie Zhou 0001 | 40 | 3 | 64 MLVU: Benchmarking Multi-task Long Video Understanding (2025) Video and Temporal Understanding 48 Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understanding (2025) Video and Temporal Understanding |
|
| 17 | Qingyi Si | 37 | 3 | 47 Multimodal Table Understanding (2024) Multimodal Evaluation and Benchmarks 47 Towards Flexible Evaluation for Generative Visual Question Answering (2024) Multimodal Evaluation and Benchmarks |
|
| 18 | Weipeng Chen | 33 | 3 | 64 Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs (2025) Video and Temporal Understanding 47 AITQE: An Adaptive Image-Text Quality Enhancer for Scalable MLLM Pretraining (2026) Multimodal Evaluation and Benchmarks |
|
| 21 | Chen Zhao 0013 | 33 | 3 | 47 Are Multimodal LLMs Robust Against Adversarial Perturbations? RoMMath: A Systematic Evaluation on Multimodal Math Reasoning (2025) Multimodal Evaluation and Benchmarks 29 LimRank: Less is More for Reasoning-Intensive Information Reranking (2025) LLM-Based Reranking |
|
| 22 | Liwei Wang 0009 | 32 | 3 | 48 AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning (2025) Video and Temporal Understanding 35 RAST: Domain-Robust Dialogue Rewriting as Sequence Tagging (2021) Conversational Search and Retrieval |
|
| 23 | Jianfeng Dong | 32 | 3 | 36 IVCR-200K: A Large-Scale Multi-turn Dialogue Benchmark for Interactive Video Corpus Retrieval (2025) Conversational Search and Retrieval 35 Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval using Language (2024) Video and Moment Retrieval |
|
| 24 | Minghui Fang 0002 | 32 | 3 | 31 Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval 31 ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control (2025) Multimodal Retrieval and Embedding |
|
| 25 | Yanzhao Zhang | 32 | 3 | 47 An End-to-End Model for Photo-Sharing Multi-Modal Dialogue Generation (2025) Multimodal Evaluation and Benchmarks 31 Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 26 | Farima Fatahi Bayat | 32 | 3 | 25 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025) Automated Fact Checking and Claim Verification 25 Enhancing Language Model Factuality via Activation-Based Confidence Calibration and Guided Decoding (2024) Automated Fact Checking and Claim Verification |
|
| 27 | Idan Szpektor | 31 | 3 | 47 Bridging the Visual Gap: Fine-Tuning Multimodal Models with Knowledge-Adapted Captions (2025) Multimodal Evaluation and Benchmarks 30 On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Method (2023) Conversational Search and Retrieval |
|
| 28 | Di Wu 0054 | 31 | 3 | 43 The Factuality Tax of Diversity-Intervened Text-to-Image Generation: Benchmark and Fact-Augmented Intervention (2024) Multimodal Evaluation and Benchmarks 32 VisRet: Visualization Improves Knowledge-Intensive Text-to-Image Retrieval (2026) Multimodal and Graph RAG |
|
| 29 | Qisheng Hu | 30 | 3 | 27 Coordinating Search-Informed Reasoning and Reasoning-Guided Search in Claim Verification (2026) Automated Fact Checking and Claim Verification 25 Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance? (2025) Automated Fact Checking and Claim Verification |
|
| 30 | Qinggang Zhang | 30 | 3 | 47 Augmenting Intra-Modal Understanding in MLLMs for Robust Multimodal Keyphrase Generation (2026) Multimodal Evaluation and Benchmarks 33 Facilitating Generative Retrieval with Logical Denoising for Interpretable Conversational Search (2026) Personalized and Conversational RAG |
|
| 31 | Jinpeng Wang 0002 | 30 | 3 | 35 Enhancing Partially Relevant Video Retrieval with Hyperbolic Learning (2025) Video and Moment Retrieval 31 Suit the Remedy to the Retriever: Interpretable Query Optimization with Retriever Preference Alignment for Vision-Language Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval |
|
| 32 | Sheng-Chieh Lin | 30 | 3 | 44 Unifying Multimodal Retrieval via Document Screenshot Embedding (2024) Universal Multimodal Embedding and MLLM Retrieval 33 Chatty Goose: A Python Framework for Conversational Search (2021) Conversational Search and Retrieval |
|
| 33 | Yu-An Liu 0028 | 29 | 3 | 31 On the Robustness of Generative Information Retrieval Models: An Out-of-Distribution Perspective (2025) Generative Retrieval 29 Black-box Adversarial Attacks against Dense Retrieval Models: A Multi-view Contrastive Learning Method (2023) Robustness and Adversarial IR |
|
| 34 | Haokun Wen | 29 | 3 | 46 Differential-Perceptive and Retrieval-Augmented MLLM for Change Captioning (2024) Multimodal and Graph RAG 28 ENCODER: Entity Mining and Modification Relation Binding for Composed Image Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 35 | Navve Wasserman | 29 | 3 | 30 DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankers (2025) Universal Multimodal Embedding and MLLM Retrieval 30 REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark (2025) Universal Multimodal Embedding and MLLM Retrieval |