Demo Data from VLDB 2026 / reviewers in the wild / expert
Baoliang Tian
dblp:408/8153
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Vision and language · 61% Trustworthy machine learning · 30% Language models and text generation · 9% |
Topics — the 3 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computer vision › Vision and language › multimodal reasoning
compositional reasoning |
1.0 | 1 | 2026 | CrossCheck-Bench: Diagnosing Compositional Failures in Multimodal Conflict Resolution · AAAI 2026 |
Computer vision › Vision and language
multimodal reasoning |
1.0 | 1 | 2026 | CrossCheck-Bench: Diagnosing Compositional Failures in Multimodal Conflict Resolution · AAAI 2026 |
Machine learning › Trustworthy machine learning
robustness |
1.0 | 1 | 2026 | CrossCheck-Bench: Diagnosing Compositional Failures in Multimodal Conflict Resolution · AAAI 2026 |
Methods — techniques the papers use, named apart from their topics
symbolic reasoning · 1.0set-of-mark prompting · 1.0chain-of-thought prompting · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | CrossCheck-Bench: Diagnosing Compositional Failures in Multimodal Conflict ResolutionabstractMultimodal Large Language Models are primarily trained and evaluated on aligned image-text pairs, which leaves their ability to detect and resolve real-world inconsistencies largely unexplored. In open-domain applications visual and textual cues often conflict, requiring models to perform structured reasoning beyond surface-level alignment. We introduce CrossCheck-Bench, a diagnostic benchmark for evaluating contradiction detection in multimodal inputs. The benchmark adopts a hierarchical task framework covering three levels of reasoning complexity and defines seven atomic capabilities essential for resolving cross-modal inconsistencies. CrossCheck-Bench includes 15k question-answer pairs sourced from real-world artifacts with synthetically injected contradictions. The dataset is constructed through a multi-stage annotation pipeline involving more than 450 expert hours to ensure semantic validity and calibrated difficulty across perception, integration, and reasoning. We evaluate 13 state-of-the-art vision-language models and observe a consistent performance drop as tasks shift from perceptual matching to logical contradiction detection. Most models perform well on isolated entity recognition but fail when multiple clues must be synthesized for conflict reasoning. Capability-level analysis further reveals uneven skill acquisition, especially in tasks requiring multi-step inference or rule-based validation. Additional probing shows that conventional prompting strategies such as Chain-of-Thought and Set-of-Mark yield only marginal gains. By contrast, methods that interleave symbolic reasoning with grounded visual processing achieve more stable improvements. These results highlight a persistent bottleneck in multimodal reasoning and suggest new directions for building models capable of robust cross-modal verification. Baoliang Tian, Yuxuan Si, Jilong Wang 0017, Lingyao Li, Zhongyuan Bao, Zineng Zhou, Sixu Li, Zhouzhuo Zhang, Yike Yun, Ke Tian, Ning Yang 0005, Minghui Qiu |
AAAI | 1 |