Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

ReAlign: Optimizing the Visual Document Retriever with Reasoning-Guided Fine-Grained Alignment

sigir26-078 · Full research paper · Hao Yang, Yifan Ji, Zhipeng Xu, Zhenghao Liu, Yukun Yan, Zulong Chen, Shuo Wang, Yu Gu, Ge Yu
Universal Multimodal Embedding and M · 50% Cross-Encoder and Neural Reranking · 25% Dense Bi-Encoder Training and Repres · 12% Domain-Specific and Multilingual Den · 12%
Abstract

Visual document retrieval aims to retrieve a set of document pages relevant to a query from visually rich collections. Existing methods often employ Vision-Language Models (VLMs) to encode queries and visual pages into a shared embedding space, which is then optimized via contrastive training. However, during visual document representation, localized evidence is usually scattered across complex document layouts, making it difficult for retrieval models to capture crucial cues for effective embedding learning. In this paper, we propose Reasoning-Guided Alignment (ReAlign), a method that enhances visual document retrieval by leveraging the reasoning capability of VLMs to provide fine-grained visual document descriptions as supervision signals for training. Specifically, ReAlign employs a superior VLM to identify query-related regions on a page and then generates a query-aware description grounding the cropped visual regions. The retriever is then trained using these region-focused descriptions to align the semantics between queries and visual documents by encouraging the document ranking distribution induced by the region-focused descriptions to match that induced by the original query. Experiments on diverse visually rich document retrieval benchmarks demonstrate that ReAlign consistently improves visual document retrieval performance on both in-domain and out-of-domain datasets, achieving up to 2% relative improvements. Moreover, the advantages of ReAlign generalize across different VLM backbones by guiding models to better focus their attention on critical visual cues for document representation. All code and datasets are available at https://github.com/NEUIR/ReAlign.

Assigned reviewers

#ReviewerMatchWhy (closest evidence publications in the taxonomy)
1 Yanzhao Zhang
56
68 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval
68 Towards Text-Image Interleaved Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
68 Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs (2025) Universal Multimodal Embedding and MLLM Retrieval
2 Jinpeng Wang 0002
51
68 Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learning (2026) Universal Multimodal Embedding and MLLM Retrieval
68 Modeling Uncertainty in Composed Image Retrieval via Probabilistic Embeddings (2025) Universal Multimodal Embedding and MLLM Retrieval
68 Imagine with Layout and Sketch: Enhancing Vision-Language Retrieval with Dual-Stream Multi-Modal Query Refinement (2026) Universal Multimodal Embedding and MLLM Retrieval

Area chair

Area chairMatch
Zhijing Wu 0001 39
Area-chair candidates (4)
Chenyan Xiong COI: co-author 4515 papers
Xiaoyi Zeng COI: co-author 4311 papers
Xiaoye Qu 4215 papers
Zhijing Wu 0001 assigned 399 papers

Candidates from the panel ranked by match score

#ReviewerMatchLoadWhy
1 Haokun Wen 68 3
68 FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
68 A Comprehensive Survey on Composed Image Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval
2 Liwei Wang 0009 58 3
68 Learning Deep Structure-Preserving Image-Text Embeddings (2016) Universal Multimodal Embedding and MLLM Retrieval
68 Improving One-Stage Visual Grounding by Recursive Sub-query Construction (2020) Universal Multimodal Embedding and MLLM Retrieval
3 Yanzhao Zhang assigned 56 3
68 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval
68 Towards Text-Image Interleaved Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
4 Jian Lang 56 3
68 Generative Thinking, Corrective Action: User-Friendly Composed Image Retrieval via Automatic Multi-Agent Collaboration (2025) Universal Multimodal Embedding and MLLM Retrieval
68 Echoes in the Feed: Evolution-aware Prompt-augmented Micro-video Popularity Prediction (2025) Universal Multimodal Embedding and MLLM Retrieval
5 Minghui Fang 0002 53 3
68 Multimodal Conditional Retrieval with High Controllability (2025) Universal Multimodal Embedding and MLLM Retrieval
68 CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling (2025) Universal Multimodal Embedding and MLLM Retrieval
6 Navve Wasserman 53 3
68 DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankers (2025) Universal Multimodal Embedding and MLLM Retrieval
68 REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark (2025) Universal Multimodal Embedding and MLLM Retrieval
7 Sheng-Chieh Lin 52 3
68 Mm-Embed: Universal Multimodal Retrieval with Multimodal LLMS (2025) Universal Multimodal Embedding and MLLM Retrieval
67 Unifying Multimodal Retrieval via Document Screenshot Embedding (2024) Universal Multimodal Embedding and MLLM Retrieval
8 Jinpeng Wang 0002 assigned 51 3
68 Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learning (2026) Universal Multimodal Embedding and MLLM Retrieval
68 Modeling Uncertainty in Composed Image Retrieval via Probabilistic Embeddings (2025) Universal Multimodal Embedding and MLLM Retrieval
9 Jurek Leonhardt 51 3
51 Extractive Explanations for Interpretable Text Ranking (2023) Cross-Encoder and Neural Reranking
42 Efficient Neural Ranking Using Forward Indexes and Lightweight Encoders (2024) Learned Sparse Retrieval Efficiency
10 Shengyao Zhuang 50 3
59 Dealing with Typos for BERT-based Passage Retrieval and Ranking (2021) Robustness and Adversarial IR
52 PromptReps: Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval (2024) Text Embedding and Representation Learning
11 Xinying Qian 50 3
68 Hyperbolic Multimodal Generative Representation Learning for Generalized Zero-Shot Multimodal Information Extraction (2026) Universal Multimodal Embedding and MLLM Retrieval
68 SMIR: Span-based multi-grained information refinement for joint multimodal entity-relation extraction (2026) Universal Multimodal Embedding and MLLM Retrieval
12 Meiyu Liang 48 3
68 Knowledge Graph Enhanced Multimodal Transformer for Image-Text Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval
68 Dynamic Self-adaptive Multiscale Distillation from Pre-trained Multimodal Large Model for Efficient Cross-modal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
13 Xuhui Sui 48 3
68 Coarse-to-fine multimodal prototype network for few-shot multimodal relation extraction (2025) Universal Multimodal Embedding and MLLM Retrieval
68 SMIR: Span-based multi-grained information refinement for joint multimodal entity-relation extraction (2026) Universal Multimodal Embedding and MLLM Retrieval
14 Xinyu Ma 0001 47 3
55 Pre-training with Aspect-Content Text Mutual Prediction for Multi-Aspect Dense Retrieval (2023) Sparse and Dense Retrieval Encoders
53 PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval (2021) Sparse and Dense Retrieval Encoders
15 Jingtao Zhan 46 3
58 An Analysis of BERT in Document Ranking (2020) Sparse and Dense Retrieval Encoders
53 Scaling Laws For Dense Retrieval (2024) Sparse and Dense Retrieval Encoders
16 Junjie Zhou 0001 46 3
68 VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval
68 MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval
18 Xueguang Ma COI: co-author 45 3
61 Fine-Tuning LLaMA for Multi-Stage Text Retrieval (2024) Sparse and Dense Retrieval Encoders
51 Toward Best Practices for Training Multilingual Dense Retrieval Models (2024) Evaluation Resources and Tools
19 Ruqing Zhang 0001 45 3
53 PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval (2021) Sparse and Dense Retrieval Encoders
53 B-PROP: Bootstrapped Pre-training with Representative Words Prediction for Ad-hoc Retrieval (2021) Sparse and Dense Retrieval Encoders
20 Jianfeng Dong 45 3
66 Exploring Content-based Video Relevance for Video Click-Through Rate Prediction (2019) Universal Multimodal Embedding and MLLM Retrieval
63 Feature Re-Learning with Data Augmentation for Content-based Video Recommendation (2018) Universal Multimodal Embedding and MLLM Retrieval
21 Xiao Wang 0043 44 3
45 An Inspection of the Reproducibility and Replicability of TCT-ColBERT (2022) Learned Sparse Retrieval Efficiency
45 Unsupervised Dense Retrieval with Conterfactual Contrastive Learning (2026) Robustness and Adversarial IR
22 Keping Bi 43 3
55 A Multi-Granularity-Aware Aspect Learning Model for Multi-Aspect Dense Retrieval (2024) Sparse and Dense Retrieval Encoders
50 CAME: Competitively Learning a Mixture-of-Experts Model for First-stage Retrieval (2025) Dense Bi-Encoder Training and Representation Learning
24 Venktesh V 43 3
57 TagRec++: Hierarchical Label Aware Attention Network for Question Categorization (2024) Text Embedding and Representation Learning
57 Unsupervised Question Duplicate and Related Questions Detection in e-learning platforms (2023) Text Embedding and Representation Learning
25 Huiqiang Jiang 42 3
68 Attentive Mask CLIP (2023) Universal Multimodal Embedding and MLLM Retrieval
41 Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text (2023) Text Embedding and Representation Learning
26 Linchao Zhu 42 3
68 Knowledge-Enhanced Dual-Stream Zero-Shot Composed Image Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval
67 Attention as Selector: Unlocking VLM Attention for Long Document Page Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval
28 Jing Liu 0022 42 3
50 Dense Text Retrieval Based on Pretrained Language Models: A Survey (2024) Dense Bi-Encoder Training and Representation Learning
50 RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering (2021) Dense Bi-Encoder Training and Representation Learning
29 Tingyu Song 42 3
67 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval
37 Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systems (2026) Reasoning-Intensive Retrieval and Ranking
30 Zheng Zhang 0006 42 3
42 Enhancing Cross-Modal Retrieval via Visual-Textual Prompt Hashing (2024) Cross-Modal Hashing and Quantization
42 Inductive Structure Consistent Hashing via Flexible Semantic Calibration (2021) Cross-Modal Hashing and Quantization
31 Fengling Li 0001 41 3
42 Noise-Robust Generative Hashing for Cross-Modal Retrieval (2026) Cross-Modal Hashing and Quantization
42 One for more: Structured Multi-Modal Hashing for multiple multimedia retrieval tasks (2023) Cross-Modal Hashing and Quantization
32 Jiuqiang Li 0002 41 3
67 Multi-view Semantic Contrastive Alignment for Multimodal Recommendation (2026) Universal Multimodal Embedding and MLLM Retrieval
24 Disentangled Contrastive Bundle Recommendation with Conditional Diffusion (2025) Diffusion and Flow Recommenders
33 Franco Maria Nardini 40 3
50 Efficient Re-ranking with Cross-encoders via Early Exit (2025) Learned Sparse Retrieval Efficiency
50 Quality versus efficiency in document scoring with learning-to-rank models (2016) Learned Sparse Retrieval Efficiency