Demo Data from SIGIR 2026 / reviewers in the wild / expert
Honghui Sheng
dblp:439/4616
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Vision and language · 50% Language models and text generation · 50% |
Topics — the 2 heaviest of 2, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computer vision › Vision and language › vision-language model › multimodal large language model
GUI agent |
1.0 | 1 | 2026 | DAC-Bench: A Decision-Aware Benchmark for Compositional Mobile GUI Tasks · ACL (1) 2026 |
Natural language and speech › Language models and text generation › LLM agents
mobile GUI agent |
1.0 | 1 | 2026 | DAC-Bench: A Decision-Aware Benchmark for Compositional Mobile GUI Tasks · ACL (1) 2026 |
Methods — techniques the papers use, named apart from their topics
large multimodal model · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | DAC-Bench: A Decision-Aware Benchmark for Compositional Mobile GUI TasksabstractMobile GUI agents powered by LMMs can perceive screens and follow instructions, yet existing benchmarks largely target short, linear workflows and step-level accuracy, offering limited insight into long-horizon planning and decision-making under branching structures.We present DAC-Bench, a decisionaware benchmark with compositional tasks comprising 830 episodes and 11,345 action steps across 35 applications on Android and iOS.Tasks are organized into Sequential, Conjunctive, Conditional, and Hierarchical structures, reflecting real-world multi-step and branching interaction patterns.To complement standard step-level evaluation, we introduce weighted longest common subsequence to capture length-sensitive progress and decision accuracy for branch correctness.Evaluations across 7 diverse agents show substantial performance degradation compared to prior benchmarks, with success rates dropping below 5% on 6-8 step tasks and branch accuracy averaging 38%, highlighting challenges in conditional decision-making.By exposing these failure modes, DAC-Bench provides a challenging and diagnostic benchmark for advancing decision-aware mobile GUI agents.Our Honghui Sheng, Xueyu Hu, Shengyu Zhang 0001, Fei Wu 0001 |
ACL (1) | 2 |