R3Check: Reinforcement Learning for Iterative Retrieval and Structured Reasoning in Complex Fact Checking
Abstract
Automated fact-checking aims to verify the veracity of claims based on related evidence, and has become increasingly important as large language models (LLMs) make it easier to generate and disseminate misinformation at scale. In open settings, effective fact-checking requires models to iteratively retrieve relevant evidence and reason over noisy and incomplete information. While recent LLM-based approaches have shown promising reasoning capabilities, prompt-based methods remain limited by the inherent behaviors of base LLMs, and supervised fine-tuning methods typically require costly annotated reasoning trajectories. In this paper, we propose R3Check, a rule-guided reinforcement learning framework that enables LLMs to perform iterative retrieval–reasoning for multi-hop fact-checking. R3Check formulates the retriever as an external environment and optimizes the model using Group Relative Policy Optimization, relying only on final veracity labels and format-based rewards rather than explicit reasoning annotations. To mitigate the mutual interference between retrieval and reasoning that arises under joint training, we introduce a two-stage curriculum that first trains structured reasoning under closed fact-checking with gold evidence, and then jointly optimizes retrieval and reasoning with real-time retrieval. An importance-based sampling strategy further strengthens effective supervision signals during training. Despite using only a 7B backbone, R3Check outperforms existing baselines and even powerful reasoning LLMs, under both given-evidence and real-time retrieval settings, while producing interpretable reasoning chains. This work demonstrates the potential of pure reinforcement learning to induce effective retrieval–reasoning behaviors for fact-checking under weak supervision.
Assigned reviewers
| # | Reviewer | Match | Why (closest evidence publications in the taxonomy) | |
|---|---|---|---|---|
| 1 | Farima Fatahi Bayat | 71 | 63 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025) Automated Fact Checking and Claim Verification 63 Enhancing Language Model Factuality via Activation-Based Confidence Calibration and Guided Decoding (2024) Automated Fact Checking and Claim Verification 44 From Proof to Program: Characterizing Tool-Induced Reasoning Hallucinations in Large Language Models (2026) Reward Modeling and Process Supervision |
|
| 2 | Qisheng Hu | 57 | 87 Coordinating Search-Informed Reasoning and Reasoning-Guided Search in Claim Verification (2026) Automated Fact Checking and Claim Verification 63 Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance? (2025) Automated Fact Checking and Claim Verification 34 Just What You Desire: Constrained Timeline Summarization with Self-Reflection for Enhanced Relevance (2025) Multi-hop and Complex Reasoning QA |
Area chair
| Area chair | Match | |
|---|---|---|
| Dacheng Tao | 45 |
Area-chair candidates (4)
| Dacheng Tao assigned | 45 | 5 papers | |
| Xiaoxi Li 0005 | 42 | 15 papers | |
| Yi R. Fung 0001 | 36 | 10 papers | |
| Hongjin Qian | 33 | 12 papers |
Candidates from the panel ranked by match score
| # | Reviewer | Match | Load | Why | |
|---|---|---|---|---|---|
| 1 | Farima Fatahi Bayat assigned | 71 | 3 | 63 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025) Automated Fact Checking and Claim Verification 63 Enhancing Language Model Factuality via Activation-Based Confidence Calibration and Guided Decoding (2024) Automated Fact Checking and Claim Verification |
|
| 2 | Weizhi Xu 0002 | 64 | 3 | 65 Counterfactual Debiasing for Fact Verification (2023) Popularity Bias and Debiasing in Recommendation 63 Heterogeneous Graph Reasoning for Fact Checking over Texts and Tables (2024) Automated Fact Checking and Claim Verification |
|
| 3 | Qisheng Hu assigned | 57 | 3 | 87 Coordinating Search-Informed Reasoning and Reasoning-Guided Search in Claim Verification (2026) Automated Fact Checking and Claim Verification 63 Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance? (2025) Automated Fact Checking and Claim Verification |
|
| 5 | Bo Wang 0069 | 43 | 3 | 63 A Graph-Enhanced Defense Framework for Explainable Fake News Detection with LLM (2026) Automated Fact Checking and Claim Verification 63 Explainable Fake News Detection with Large Language Model via Defense Among Competing Wisdom (2024) Automated Fact Checking and Claim Verification |
|
| 6 | Kaixin Ma | 43 | 3 | 50 WebEvolver: Enhancing Web Agent Self-Improvement with Co-evolving World Model (2025) RL Training of Search Agents 50 OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization (2025) RL Training of Search Agents |
|
| 7 | Jialong Wu 0007 | 43 | 3 | 54 WebDancer: Towards Autonomous Information Seeking Agency (2025) Deep Research and Report Generation 54 Nested Browser-Use Learning for Agentic Information Seeking (2026) Deep Research and Report Generation |
|
| 8 | Mariano Barone | 43 | 3 | 68 Combining Evidence and Reasoning for Biomedical Fact-Checking (2025) Automated Fact Checking and Claim Verification 67 Combating Biomedical Misinformation through Multi-modal Claim Detection and Evidence-based Verification (2025) RAG for Domain Applications |
|
| 9 | Chen Zhao 0013 | 42 | 3 | 63 FinDVer: Explainable Claim Verification over Long and Hybrid-content Financial Documents (2024) Automated Fact Checking and Claim Verification 63 Large Language Models Help Humans Verify Truthfulness - Except When They Are Convincingly Wrong (2024) Automated Fact Checking and Claim Verification |
|
| 11 | Ruichao Yang | 40 | 3 | 67 A Graph-Enhanced Defense Framework for Explainable Fake News Detection with LLM (2026) RAG for Domain Applications 63 Explainable Fake News Detection with Large Language Model via Defense Among Competing Wisdom (2024) Automated Fact Checking and Claim Verification |
|
| 12 | Armin Toroghi | 40 | 3 | 64 CoLoTa: A Dataset for Entity-based Commonsense Reasoning over Long-Tail Knowledge (2025) Automated Fact Checking and Claim Verification 64 Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering (2024) Automated Fact Checking and Claim Verification |
|
| 13 | Haritz Puerto | 39 | 3 | 41 Code Prompting Elicits Conditional Reasoning Abilities in Text+Code LLMs (2024) Reward Modeling and Process Supervision 41 Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs (2025) Reward Modeling and Process Supervision |
|
| 14 | Yuanzhao Zhai | 39 | 3 | 64 Empowering Large Language Model Agent through Step-Level Self-Critique and Self-Training (2025) Reward Modeling and Process Supervision 64 Enhancing Decision-Making for LLM Agents via Step-Level Q-Value Models (2025) Reward Modeling and Process Supervision |
|
| 15 | Shu Zhou 0002 | 38 | 3 | 67 Calibrating Uncertainty with Cross-Model Consistency for LLM Hallucination Mitigation (2026) Knowledge Conflict and Faithfulness 67 Cascaded Verification Framework: A Progressive Approach for Mitigating Hallucinations in Large Language Models (2026) Knowledge Conflict and Faithfulness |
|
| 16 | Venktesh V | 37 | 3 | 63 The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval (2025) Automated Fact Checking and Claim Verification 63 FlashCheck: Exploration of Efficient Evidence Retrieval for Fast Fact-Checking (2025) Automated Fact Checking and Claim Verification |
|
| 17 | Sajad Ebrahimi 0001 | 37 | 3 | 63 Peerispect: Claim Verification in Scientific Peer Reviews (2026) Automated Fact Checking and Claim Verification 29 PeerPrism: Peer Evaluation Expertise vs Review-writing AI (2026) Fake News, Fact Checking and Misinformation › Others |
|
| 18 | Wonduk Seo | 36 | 3 | 41 SPIO: Ensemble and Selective Strategies via LLM-Based Multi-Agent Planning in Automated Data Science (2026) Multi-Agent and Tool-Use Orchestration 40 Automated Visualization Code Synthesis via Multi-path Reasoning and Feedback-Driven Optimizations (2026) Reasoning Evaluation and Benchmarks |
|
| 20 | Daiting Shi | 36 | 3 | 50 Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026) RL Training of Search Agents 41 ConsistRM: Improving Generative Reward Models via Consistency-Aware Self-Training (2026) Reward Modeling and Process Supervision |
|
| 21 | Ben Liu 0002 | 36 | 3 | 56 Plan Then Retrieve: Reinforcement Learning-Guided Complex Reasoning over Knowledge Graphs (2026) RL Training of Search Agents 48 SymAgent: A Neural-Symbolic Self-Learning Agent Framework for Complex Reasoning over Knowledge Graphs (2025) Reasoning Evaluation and Benchmarks |
|
| 22 | Farzad Shami | 35 | 3 | 42 GROKE: Vision-Free Navigation Instruction Evaluation via Graph Reasoning on OpenStreetMap (2026) Reasoning Evaluation and Benchmarks 34 Benchmarking Large Language Models for Knowledge Graph Validation (2026) KG-Augmented LLM Reasoning |
|
| 23 | Archiki Prasad | 35 | 3 | 53 MAgICoRe: Multi-Agent, Iterative, Coarse-to-Fine Refinement for Reasoning (2025) Reward Modeling and Process Supervision 41 PRInTS: Reward Modeling for Long-Horizon Information Seeking (2026) Reward Modeling and Process Supervision |
|
| 24 | Yu Gu 0016 | 35 | 3 | 42 Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (2024) KG-Augmented LLM Reasoning 40 AgentBench: Evaluating LLMs as Agents (2024) Reasoning Evaluation and Benchmarks |
|
| 25 | Wenlin Zhang 0001 | 35 | 3 | 57 Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning (2025) Agentic and Deep Search RAG 55 To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal Intervention (2026) Agentic and Deep Search RAG |
|
| 26 | Qingyi Si | 35 | 3 | 64 Are Large Language Models Table-based Fact-Checkers? (2024) Automated Fact Checking and Claim Verification 52 S-GRPO: Early Exit via Reinforcement Learning in Reasoning Models (2025) Reward Modeling and Process Supervision |
|
| 27 | Idan Szpektor | 35 | 3 | 63 TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models (2023) Automated Fact Checking and Claim Verification 34 MDCure: A Scalable Pipeline for Multi-Document Instruction-Following (2025) Multi-hop and Complex Reasoning QA |
|
| 28 | Ori Yoran | 34 | 3 | 42 AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks? (2024) Reasoning Evaluation and Benchmarks 41 Answering Questions by Meta-Reasoning over Multiple Chains of Thought (2023) Reasoning-Intensive Retrieval and Ranking |
|
| 29 | Yong Li 0004 | 34 | 3 | 41 RFS-Guard: Detecting Reasoning Hallucinations via Cross-Phase Routing Focus in Large Reasoning Models (2026) Reward Modeling and Process Supervision 41 PG-Agent: An Agent Powered by Page Graph (2025) Multi-Agent and Tool-Use Orchestration |
|
| 30 | Yongqi Li 0001 | 34 | 3 | 47 R$^2$ec: Towards Large Recommender Models with Reasoning (2025) Preference Alignment and Optimization 41 Parallel Test-Time Scaling for Latent Reasoning Models (2026) Reward Modeling and Process Supervision |
|
| 31 | Yingyi Zhang 0001 | 34 | 3 | 69 To Search or Not to Search: Aligning the Decision Boundary of Deep Search Agents via Causal Intervention (2026) Agentic and Deep Search RAG 57 Process vs. Outcome Reward: Which is Better for Agentic RAG Reinforcement Learning (2025) Agentic and Deep Search RAG |
|
| 32 | Adam Jatowt | 34 | 3 | 34 ArchivalQA: A Large-scale Benchmark Dataset for Open-Domain Question Answering over Historical News Collections (2022) Multi-hop and Complex Reasoning QA 34 Inferential Question Answering (2026) Multi-hop and Complex Reasoning QA |
|
| 33 | Jiapu Wang | 34 | 3 | 54 Large Language Models-guided Dynamic Adaptation for Temporal Knowledge Graph Reasoning (2024) RL Training of Search Agents 36 Unifying Large Language Models and Knowledge Graphs: A Roadmap (2024) KG-Augmented LLM Reasoning |