Demo Data from VLDB 2026 / reviewers in the wild / expert
Haoyi Hu
dblp:399/1885
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Vision and language · 40% Reinforcement learning · 40% Multi-agent systems · 20% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Reinforcement learning › reward design › reward shaping
dense reward shaping |
1.0 | 1 | 2026 | GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026 |
Computer vision › Vision and language › vision-language model › multimodal large language model
GUI agent |
1.0 | 1 | 2026 | GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026 |
Machine learning › Reinforcement learning
reward design |
1.0 | 1 | 2026 | GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026 |
Knowledge, reasoning and agents › Multi-agent systems › agentic AI
tool-augmented agents |
1.0 | 1 | 2026 | GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026 |
Computer vision › Vision and language
visual grounding |
1.0 | 1 | 2026 | GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026 |
Methods — techniques the papers use, named apart from their topics
two-level policy · 1.0reinforcement learning · 1.0progressive perception · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI AgentsabstractRecent advances in vision-language models (VLMs) and reinforcement learning (RL) have driven progress in GUI automation. However, most existing methods rely on static, one-shot visual inputs and passive perception, lacking the ability to adaptively determine when, whether, and how to observe the interface. We present GUI-Eyes, a reinforcement learning framework for active visual perception in GUI tasks. To acquire more informative observations, the agent learns to make strategic decisions on both whether and how to invoke visual tools, such as cropping or zooming, within a two-stage reasoning process. To support this behavior, we introduce a progressive perception strategy that decomposes the decision-making into coarse exploration and fine-grained grounding, coordinated by a two-level policy. In addition, we design a spatially continuous reward function tailored to tool usage, which integrates both location proximity and region overlap to provide dense supervision and alleviate the reward sparsity common in GUI environments. On the ScreenSpot-Pro benchmark, GUI-Eyes-3B achieves 44.8% grounding accuracy using only 3k labeled samples, significantly outperforming both supervised and RL-based baselines. These results highlight that tool-aware active perception, enabled by staged policy reasoning and fine-grained reward feedback, is critical for building robust and data-efficient GUI agents. Jiawei Shao, Dakuan Lu, Haoyi Hu, Xiangcheng Liu, Hantao Yao, Wu Liu 0005 |
AAAI | 4 |