ReAlign: Optimizing the Visual Document Retriever with Reasoning-Guided Fine-Grained Alignment
Abstract
Visual document retrieval aims to retrieve a set of document pages relevant to a query from visually rich collections. Existing methods often employ Vision-Language Models (VLMs) to encode queries and visual pages into a shared embedding space, which is then optimized via contrastive training. However, during visual document representation, localized evidence is usually scattered across complex document layouts, making it difficult for retrieval models to capture crucial cues for effective embedding learning. In this paper, we propose Reasoning-Guided Alignment (ReAlign), a method that enhances visual document retrieval by leveraging the reasoning capability of VLMs to provide fine-grained visual document descriptions as supervision signals for training. Specifically, ReAlign employs a superior VLM to identify query-related regions on a page and then generates a query-aware description grounding the cropped visual regions. The retriever is then trained using these region-focused descriptions to align the semantics between queries and visual documents by encouraging the document ranking distribution induced by the region-focused descriptions to match that induced by the original query. Experiments on diverse visually rich document retrieval benchmarks demonstrate that ReAlign consistently improves visual document retrieval performance on both in-domain and out-of-domain datasets, achieving up to 2% relative improvements. Moreover, the advantages of ReAlign generalize across different VLM backbones by guiding models to better focus their attention on critical visual cues for document representation. All code and datasets are available at https://github.com/NEUIR/ReAlign.
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Yanzhao Zhang | 56 | 68 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval 68 Towards Text-Image Interleaved Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval 68 Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 2 | Jinpeng Wang 0002 | 51 | 68 Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learning (2026) Universal Multimodal Embedding and MLLM Retrieval 68 Modeling Uncertainty in Composed Image Retrieval via Probabilistic Embeddings (2025) Universal Multimodal Embedding and MLLM Retrieval 68 Imagine with Layout and Sketch: Enhancing Vision-Language Retrieval with Dual-Stream Multi-Modal Query Refinement (2026) Universal Multimodal Embedding and MLLM Retrieval |
Area chair
| Area chair | Match | |
|---|---|---|
| Zhijing Wu 0001 | 39 |
Area-chair candidates (4)
| Chenyan Xiong COI: co-author | 45 | 15 papers | |
| Xiaoyi Zeng COI: co-author | 43 | 11 papers | |
| Xiaoye Qu | 42 | 15 papers | |
| Zhijing Wu 0001 assigned | 39 | 9 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Haokun Wen | 68 | 3 | 68 FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval 68 A Comprehensive Survey on Composed Image Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval |
|
| 2 | Liwei Wang 0009 | 58 | 3 | 68 Learning Deep Structure-Preserving Image-Text Embeddings (2016) Universal Multimodal Embedding and MLLM Retrieval 68 Improving One-Stage Visual Grounding by Recursive Sub-query Construction (2020) Universal Multimodal Embedding and MLLM Retrieval |
|
| 3 | Yanzhao Zhang assigned | 56 | 3 | 68 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval 68 Towards Text-Image Interleaved Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 4 | Jian Lang | 56 | 3 | 68 Generative Thinking, Corrective Action: User-Friendly Composed Image Retrieval via Automatic Multi-Agent Collaboration (2025) Universal Multimodal Embedding and MLLM Retrieval 68 Echoes in the Feed: Evolution-aware Prompt-augmented Micro-video Popularity Prediction (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 5 | Minghui Fang 0002 | 53 | 3 | 68 Multimodal Conditional Retrieval with High Controllability (2025) Universal Multimodal Embedding and MLLM Retrieval 68 CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 6 | Navve Wasserman | 53 | 3 | 68 DocReRank: Single-Page Hard Negative Query Generation for Training Multi-Modal RAG Rerankers (2025) Universal Multimodal Embedding and MLLM Retrieval 68 REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 7 | Sheng-Chieh Lin | 52 | 3 | 68 Mm-Embed: Universal Multimodal Retrieval with Multimodal LLMS (2025) Universal Multimodal Embedding and MLLM Retrieval 67 Unifying Multimodal Retrieval via Document Screenshot Embedding (2024) Universal Multimodal Embedding and MLLM Retrieval |
|
| 8 | Jinpeng Wang 0002 assigned | 51 | 3 | 68 Heterogeneous Uncertainty-Guided Composed Image Retrieval with Fine-Grained Probabilistic Learning (2026) Universal Multimodal Embedding and MLLM Retrieval 68 Modeling Uncertainty in Composed Image Retrieval via Probabilistic Embeddings (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 9 | Jurek Leonhardt | 51 | 3 | 51 Extractive Explanations for Interpretable Text Ranking (2023) Cross-Encoder and Neural Reranking 42 Efficient Neural Ranking Using Forward Indexes and Lightweight Encoders (2024) Learned Sparse Retrieval Efficiency |
|
| 10 | Shengyao Zhuang | 50 | 3 | 59 Dealing with Typos for BERT-based Passage Retrieval and Ranking (2021) Robustness and Adversarial IR 52 PromptReps: Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval (2024) Text Embedding and Representation Learning |
|
| 11 | Xinying Qian | 50 | 3 | 68 Hyperbolic Multimodal Generative Representation Learning for Generalized Zero-Shot Multimodal Information Extraction (2026) Universal Multimodal Embedding and MLLM Retrieval 68 SMIR: Span-based multi-grained information refinement for joint multimodal entity-relation extraction (2026) Universal Multimodal Embedding and MLLM Retrieval |
|
| 12 | Meiyu Liang | 48 | 3 | 68 Knowledge Graph Enhanced Multimodal Transformer for Image-Text Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval 68 Dynamic Self-adaptive Multiscale Distillation from Pre-trained Multimodal Large Model for Efficient Cross-modal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 13 | Xuhui Sui | 48 | 3 | 68 Coarse-to-fine multimodal prototype network for few-shot multimodal relation extraction (2025) Universal Multimodal Embedding and MLLM Retrieval 68 SMIR: Span-based multi-grained information refinement for joint multimodal entity-relation extraction (2026) Universal Multimodal Embedding and MLLM Retrieval |
|
| 14 | Xinyu Ma 0001 | 47 | 3 | 55 Pre-training with Aspect-Content Text Mutual Prediction for Multi-Aspect Dense Retrieval (2023) Sparse and Dense Retrieval Encoders 53 PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval (2021) Sparse and Dense Retrieval Encoders |
|
| 15 | Jingtao Zhan | 46 | 3 | 58 An Analysis of BERT in Document Ranking (2020) Sparse and Dense Retrieval Encoders 53 Scaling Laws For Dense Retrieval (2024) Sparse and Dense Retrieval Encoders |
|
| 16 | Junjie Zhou 0001 | 46 | 3 | 68 VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval 68 MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval (2025) Universal Multimodal Embedding and MLLM Retrieval |
|
| 18 | Xueguang Ma COI: co-author | 45 | 3 | 61 Fine-Tuning LLaMA for Multi-Stage Text Retrieval (2024) Sparse and Dense Retrieval Encoders 51 Toward Best Practices for Training Multilingual Dense Retrieval Models (2024) Evaluation Resources and Tools |
|
| 19 | Ruqing Zhang 0001 | 45 | 3 | 53 PROP: Pre-training with Representative Words Prediction for Ad-hoc Retrieval (2021) Sparse and Dense Retrieval Encoders 53 B-PROP: Bootstrapped Pre-training with Representative Words Prediction for Ad-hoc Retrieval (2021) Sparse and Dense Retrieval Encoders |
|
| 20 | Jianfeng Dong | 45 | 3 | 66 Exploring Content-based Video Relevance for Video Click-Through Rate Prediction (2019) Universal Multimodal Embedding and MLLM Retrieval 63 Feature Re-Learning with Data Augmentation for Content-based Video Recommendation (2018) Universal Multimodal Embedding and MLLM Retrieval |
|
| 21 | Xiao Wang 0043 | 44 | 3 | 45 An Inspection of the Reproducibility and Replicability of TCT-ColBERT (2022) Learned Sparse Retrieval Efficiency 45 Unsupervised Dense Retrieval with Conterfactual Contrastive Learning (2026) Robustness and Adversarial IR |
|
| 22 | Keping Bi | 43 | 3 | 55 A Multi-Granularity-Aware Aspect Learning Model for Multi-Aspect Dense Retrieval (2024) Sparse and Dense Retrieval Encoders 50 CAME: Competitively Learning a Mixture-of-Experts Model for First-stage Retrieval (2025) Dense Bi-Encoder Training and Representation Learning |
|
| 24 | Venktesh V | 43 | 3 | 57 TagRec++: Hierarchical Label Aware Attention Network for Question Categorization (2024) Text Embedding and Representation Learning 57 Unsupervised Question Duplicate and Related Questions Detection in e-learning platforms (2023) Text Embedding and Representation Learning |
|
| 25 | Huiqiang Jiang | 42 | 3 | 68 Attentive Mask CLIP (2023) Universal Multimodal Embedding and MLLM Retrieval 41 Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text (2023) Text Embedding and Representation Learning |
|
| 26 | Linchao Zhu | 42 | 3 | 68 Knowledge-Enhanced Dual-Stream Zero-Shot Composed Image Retrieval (2024) Universal Multimodal Embedding and MLLM Retrieval 67 Attention as Selector: Unlocking VLM Attention for Long Document Page Retrieval (2026) Universal Multimodal Embedding and MLLM Retrieval |
|
| 28 | Jing Liu 0022 | 42 | 3 | 50 Dense Text Retrieval Based on Pretrained Language Models: A Survey (2024) Dense Bi-Encoder Training and Representation Learning 50 RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering (2021) Dense Bi-Encoder Training and Representation Learning |
|
| 29 | Tingyu Song | 42 | 3 | 67 Rethinking Composed Image Retrieval Evaluation: A Fine-Grained Benchmark from Image Editing (2026) Universal Multimodal Embedding and MLLM Retrieval 37 Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systems (2026) Reasoning-Intensive Retrieval and Ranking |
|
| 30 | Zheng Zhang 0006 | 42 | 3 | 42 Enhancing Cross-Modal Retrieval via Visual-Textual Prompt Hashing (2024) Cross-Modal Hashing and Quantization 42 Inductive Structure Consistent Hashing via Flexible Semantic Calibration (2021) Cross-Modal Hashing and Quantization |
|
| 31 | Fengling Li 0001 | 41 | 3 | 42 Noise-Robust Generative Hashing for Cross-Modal Retrieval (2026) Cross-Modal Hashing and Quantization 42 One for more: Structured Multi-Modal Hashing for multiple multimedia retrieval tasks (2023) Cross-Modal Hashing and Quantization |
|
| 32 | Jiuqiang Li 0002 | 41 | 3 | 67 Multi-view Semantic Contrastive Alignment for Multimodal Recommendation (2026) Universal Multimodal Embedding and MLLM Retrieval 24 Disentangled Contrastive Bundle Recommendation with Conditional Diffusion (2025) Diffusion and Flow Recommenders |
|
| 33 | Franco Maria Nardini | 40 | 3 | 50 Efficient Re-ranking with Cross-encoders via Early Exit (2025) Learned Sparse Retrieval Efficiency 50 Quality versus efficiency in document scoring with learning-to-rank models (2016) Learned Sparse Retrieval Efficiency |