Demo Data from SIGIR 2026 / reviewers in the wild / expert
Zongze Du
dblp:408/7706
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Reinforcement learning · 56% Vision and language · 28% Video understanding and tracking · 8% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computer vision › Vision and language › multimodal reasoning
audio-visual reasoning |
0.9 | 1 | 2025 | Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaboration · NeurIPS 2025 |
Machine learning › Reinforcement learning › policy optimization
group relative policy optimization |
0.9 | 1 | 2025 | Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaboration · NeurIPS 2025 |
Machine learning › Reinforcement learning
policy optimization |
0.9 | 1 | 2025 | Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaboration · NeurIPS 2025 |
Computer vision › Segmentation and scene understanding › audio-visual segmentation
referring audio-visual segmentation |
0.3 | 1 | 2025 | Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaboration · NeurIPS 2025 |
Computer vision › Video understanding and tracking
video object segmentation |
0.3 | 1 | 2025 | Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaboration · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
reinforcement learning · 0.9keyframe selection · 0.9hierarchical rewards · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System CollaborationabstractLong-horizon video-audio reasoning and fine-grained pixel understanding impose conflicting requirements on omnimodal models: dense temporal coverage demands many low-resolution frames, whereas precise grounding calls for high-resolution inputs. We tackle this trade-off with a two-system architecture: a Global Reasoning System selects informative keyframes and rewrites the task at low spatial cost, while a Detail Understanding System performs pixel-level grounding on the selected high-resolution snippets.
Because "optimal" keyframe selection and reformulation are ambiguous and hard to supervise, we formulate them as a reinforcement-learning (RL) problem and present Omni-R1, an end-to-end RL framework built on Group Relative Policy Optimization.
Omni-R1 trains the Global Reasoning System through hierarchical rewards obtained via online collaboration with the Detail Understanding System, requiring only one epoch of RL on small task splits.
Experiments on two challenging benchmarks, Referring Audio-Visual Segmentation (RefAVS) and Reasoning Video Object Segmentation (REVOS), show that Omni-R1 not only surpasses strong supervised baselines but also outperforms specialized state-of-the-art models, while substantially improving out-of-domain generalization and mitigating multimodal hallucination.
Our results demonstrate the first successful application of RL to large-scale omnimodal reasoning and highlight a scalable path toward universally foundation models. Muzhi Zhu, Zongze Du, Canyu Zhao, Wen Wang 0015, Hao Chen 0041, Chunhua Shen |
NeurIPS | 3 |