TimelineReasoner: Advancing Timeline Summarization with Large Reasoning Models
Abstract
The proliferation of online news poses a challenge to extracting structured timelines from unstructured content. While recent studies have shown that Large Language Models (LLMs) can assist Timeline Summarization (TLS), these approaches primarily treat models as passive generators. The emergence of Large Reasoning Models (LRMs) presents an opportunity to reason over events actively, enabling iterative evidence acquisition, the detection of missing events, and the validation of temporal consistency. To leverage the reasoning capabilities of LRMs, we propose TimelineReasoner, a novel framework that shifts TLS from static generation to an active, reasoning-driven process. TimelineReasoner adopts a two-stage framework: Global Cognition, which tracks events at a macroscopic level and continuously updates a global event memory, and Detail Exploration, which identifies informational gaps and refines the timeline via targeted document retrieval. To support this, TimelineReasoner incorporates several specialized mechanisms, including an Event Scraper for retrieving temporal event descriptions, a Timeline Updater for refining the timeline, and a Supervisor for detecting gaps in the timeline and guiding retrieval. Experimental results on open-domain TLS datasets demonstrate that TimelineReasoner significantly outperforms existing LLM-based TLS methods in terms of timeline accuracy, coverage, and coherence. On closed-domain TLS datasets, our method performs on par with or exceeds state-of-the-art approaches. This work not only pushes the boundaries of TLS but also highlights the broader potential of LRM-based reasoning frameworks for timeline summarization.
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Yu Gu 0016 | 50 | 68 Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge (2025) Deep Research and Report Generation 68 Few-shot In-context Learning on Knowledge Base Question Answering (2023) Multi-hop and Complex Reasoning QA 68 Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments (2023) Knowledge Graph Question Answering |
|
| 2 | Ori Yoran | 48 | 74 Answering Questions by Meta-Reasoning over Multiple Chains of Thought (2023) Reasoning-Intensive Retrieval and Ranking 66 Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills (2022) Multi-hop and Complex Reasoning QA 57 Making Retrieval-Augmented Language Models Robust to Irrelevant Context (2024) Evidence Selection and Context Refinement |
|
| 3 | Xi Ye 0003 | 45 | 70 Connecting Attributions and QA Model Behavior on Realistic Counterfactuals (2021) Multi-hop and Complex Reasoning QA 68 Beyond Single-shot Writing: Deep Research Agents are Unreliable at Multi-turn Report Revision (2026) Deep Research and Report Generation 68 RNG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question Answering (2022) Knowledge Graph Question Answering |
Area chair
| Area chair | Match | |
|---|---|---|
| Zhijing Wu 0001 | 37 |
Area-chair candidates (3)
| Xiaoxi Li 0005 COI: author | 45 | 15 papers | |
| Hongjin Qian COI: co-author | 41 | 12 papers | |
| Jun Xu 0001 COI: co-author | 38 | 2 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Wenyu Huang | 55 | 3 | 70 Masking in Multi-hop QA: An Analysis of How Language Models Perform with Context Permutation (2025) Multi-hop and Complex Reasoning QA 56 Prompting large language models with knowledge graphs for question answering involving long-tail facts (2025) KG-Augmented LLM Reasoning |
|
| 2 | Adam Jatowt | 54 | 3 | 70 ArchivalQA: A Large-scale Benchmark Dataset for Open-Domain Question Answering over Historical News Collections (2022) Multi-hop and Complex Reasoning QA 70 Do Language Models Have a Common Sense regarding Time? Revisiting Temporal Commonsense Reasoning in the Era of Large Language Models (2023) Multi-hop and Complex Reasoning QA |
|
| 3 | Chen Zhao 0013 | 53 | 3 | 70 TaPERA: Enhancing Faithfulness and Interpretability in Long-Form Table QA by Content Planning and Execution-based Reasoning (2024) Multi-hop and Complex Reasoning QA 70 RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations (2023) Multi-hop and Complex Reasoning QA |
|
| 4 | Jialong Wu 0007 | 52 | 3 | 70 OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking (2025) Deep Research and Report Generation 66 WebDancer: Towards Autonomous Information Seeking Agency (2025) Deep Research and Report Generation |
|
| 5 | Yu Gu 0016 assigned | 50 | 3 | 68 Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge (2025) Deep Research and Report Generation 68 Few-shot In-context Learning on Knowledge Base Question Answering (2023) Multi-hop and Complex Reasoning QA |
|
| 6 | Qisheng Hu | 49 | 3 | 70 Just What You Desire: Constrained Timeline Summarization with Self-Reflection for Enhanced Relevance (2025) Multi-hop and Complex Reasoning QA 42 Coordinating Search-Informed Reasoning and Reasoning-Guided Search in Claim Verification (2026) Automated Fact Checking and Claim Verification |
|
| 7 | Ori Yoran assigned | 48 | 3 | 74 Answering Questions by Meta-Reasoning over Multiple Chains of Thought (2023) Reasoning-Intensive Retrieval and Ranking 66 Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills (2022) Multi-hop and Complex Reasoning QA |
|
| 8 | Qinggang Zhang | 47 | 3 | 70 Knapsack Optimization-Based Schema Linking for LLM-Based Text-to-SQL Generation (2026) Multi-hop and Complex Reasoning QA 68 Cost-efficient Knowledge-based Question Answering with Large Language Models (2024) Multi-hop and Complex Reasoning QA |
|
| 9 | Xi Ye 0003 assigned | 45 | 3 | 70 Connecting Attributions and QA Model Behavior on Realistic Counterfactuals (2021) Multi-hop and Complex Reasoning QA 68 Beyond Single-shot Writing: Deep Research Agents are Unreliable at Multi-turn Report Revision (2026) Deep Research and Report Generation |
|
| 11 | Farzad Shami | 43 | 3 | 47 From Single to Multi-agent Reasoning: Advancing GeneGPT for Genomics QA (2026) Retrieval-Augmented and Open-Domain QA 42 GROKE: Vision-Free Navigation Instruction Evaluation via Graph Reasoning on OpenStreetMap (2026) Reasoning Evaluation and Benchmarks |
|
| 12 | Tianzhe Zhao | 43 | 3 | 73 Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond (2025) Reasoning Evaluation and Benchmarks 67 PathReasoner: Modeling Reasoning Path with Equivalent Extension for Logical Question Answering (2024) Search Agents and LLM Reasoning › Others |
|
| 13 | Idan Szpektor | 43 | 3 | 66 MDCure: A Scalable Pipeline for Multi-Document Instruction-Following (2025) Multi-hop and Complex Reasoning QA 47 SIGIR 2016 Workshop WebQA II: Web Question Answering Beyond Factoids (2016) Retrieval-Augmented and Open-Domain QA |
|
| 14 | Wenlin Zhang 0001 | 42 | 3 | 71 MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search (2026) Agentic and Deep Search RAG 69 Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery (2026) Deep Research and Report Generation |
|
| 15 | Xinying Qian | 42 | 3 | 70 Beyond Timestamps: Bridging Forward and Backward Reasoning in Temporal Numerical and Relational Understanding (2026) Multi-hop and Complex Reasoning QA 43 TimeR⁴ : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering (2024) Multi-Hop and Iterative Retrieval Reasoning |
|
| 16 | Wonduk Seo | 42 | 3 | 42 SPIO: Ensemble and Selective Strategies via LLM-Based Multi-Agent Planning in Automated Data Science (2026) Multi-Agent and Tool-Use Orchestration 41 Automated Visualization Code Synthesis via Multi-path Reasoning and Feedback-Driven Optimizations (2026) Reasoning Evaluation and Benchmarks |
|
| 17 | Kaixin Ma | 42 | 3 | 47 Open Domain Question Answering with A Unified Knowledge Interface (2022) Multimodal and Graph RAG 45 Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering (2021) Retrieval-Augmented and Open-Domain QA |
|
| 19 | Yuzhong Qu | 41 | 3 | 68 Skeleton parsing for complex question answering over knowledge bases (2022) Knowledge Graph Question Answering 68 Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval (2024) Knowledge Graph Question Answering |
|
| 20 | Daiting Shi COI: co-author | 41 | 3 | 70 A Question-Oriented Propagation Network for News Reading Comprehension (2022) Multi-hop and Complex Reasoning QA 43 Utility-Focused LLM Annotation for Retrieval and Retrieval-Augmented Generation (2025) Evidence Selection and Context Refinement |
|
| 21 | Yingyi Zhang 0001 | 40 | 3 | 71 MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search (2026) Agentic and Deep Search RAG 69 Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery (2026) Deep Research and Report Generation |
|
| 22 | Jiapu Wang | 40 | 3 | 59 Decomposing and Revising What Language Models Generate (2025) Multi-Hop and Iterative Retrieval Reasoning 59 Atomic Fact Decomposition Helps Attributed Question Answering (2025) Multi-Hop and Iterative Retrieval Reasoning |
|
| 23 | Xingyu Tan 0001 | 39 | 3 | 42 MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoning (2026) KG-Augmented LLM Reasoning 42 Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning (2025) KG-Augmented LLM Reasoning |
|
| 24 | Mariano Barone | 39 | 3 | 50 SOLVE-Med: Specialized Orchestration for Leading Vertical Experts Across Medical Specialties (2025) Retrieval-Augmented and Open-Domain QA 44 A Multilingual Multimodal Medical Examination Dataset for Visual Question Answering in Healthcare (2025) Retrieval-Augmented and Open-Domain QA |
|
| 25 | Falk Scholer | 39 | 3 | 70 WikiHowQA: A Comprehensive Benchmark for Multi-Document Non-Factoid Question Answering (2023) Multi-hop and Complex Reasoning QA 44 Document Summarization for Answering Non-Factoid Queries (2018) Retrieval-Augmented and Open-Domain QA |
|
| 26 | Qingyi Si | 39 | 3 | 66 Are Large Language Models Table-based Fact-Checkers? (2024) Automated Fact Checking and Claim Verification 40 Combo of Thinking and Observing for Outside-Knowledge VQA (2023) Retrieval-Augmented and Open-Domain QA |
|
| 27 | Weiwei Sun 0001 COI: co-author | 39 | 3 | 44 Improving Retrieval-Augmented Generation through Multi-Agent Reinforcement Learning (2025) Agentic and Deep Search RAG 44 TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy (2025) Reasoning-Intensive Retrieval and Ranking |
|
| 28 | Armin Toroghi | 39 | 3 | 42 CommonWhy: A Dataset for Evaluating Entity-Based Causal Commonsense Reasoning in Large Language Models (2026) Knowledge Graph Question Answering 42 Bayesian Inference with Complex Knowledge Graph Evidence (2024) Knowledge Graph Question Answering |
|
| 29 | Jinheon Baek | 39 | 3 | 63 An Empirical Study of Multilingual Reasoning Distillation for Question Answering (2024) Multi-hop and Complex Reasoning QA 48 Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks (2023) Retrieval-Augmented and Open-Domain QA |
|
| 30 | Farima Fatahi Bayat | 38 | 3 | 40 From Proof to Program: Characterizing Tool-Induced Reasoning Hallucinations in Large Language Models (2026) Reward Modeling and Process Supervision 35 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025) Automated Fact Checking and Claim Verification |
|
| 31 | Ben Liu 0002 | 38 | 3 | 46 Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge Graphs (2026) RL Training of Search Agents 46 SymAgent: A Neural-Symbolic Self-Learning Agent Framework for Complex Reasoning over Knowledge Graphs (2025) Reasoning Evaluation and Benchmarks |
|
| 32 | Jing Liu 0022 | 38 | 3 | 47 A Regularized Competition Model for Question Difficulty Estimation in Community Question Answering Services (2014) Retrieval-Augmented and Open-Domain QA 45 Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation (2025) Knowledge Conflict and Faithfulness |