Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Dakuan Lu

dblp:340/7489 · DBLP profile ↗
← Back
4ranked-venue papers
0as first author
4since 2021 · last 2026
0009-0006-4937-0805ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 4 since 2021Databases, data management, data science and information retrieval · 2 · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
3 papers
Reinforcement learning · 33% Vision and language · 29% Knowledge representation and reasoning · 18%

Topics — the 11 heaviest of 11, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning › reward design › reward shaping
dense reward shaping
1.012026
GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026
Computer vision › Vision and language › vision-language model › multimodal large language model
GUI agent
1.012026
GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026
Natural language and speech › Language models and text generation
large language model reasoning
1.012026
AURORA: Automated Training Framework of Universal Process Reward Models via Ensemble Prompting and Reverse Verification · KDD (1) 2026
Machine learning › Reinforcement learning › reinforcement learning from human feedback
process reward model
1.012026
AURORA: Automated Training Framework of Universal Process Reward Models via Ensemble Prompting and Reverse Verification · KDD (1) 2026
Machine learning › Reinforcement learning
reward design
1.012026
GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026
Knowledge, reasoning and agents › Multi-agent systems › agentic AI
tool-augmented agents
1.012026
GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026
Computer vision › Vision and language
visual grounding
1.012026
GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents · AAAI 2026
Knowledge, reasoning and agents › Knowledge representation and reasoning › spatial reasoning
multi-hop spatial reasoning
0.912025
ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraints · NeurIPS 2025
Computer vision › Vision and language › vision-language model › multimodal large language model
multimodal large language model evaluation
0.912025
ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraints · NeurIPS 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning
spatial reasoning
0.912025
ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraints · NeurIPS 2025
Machine learning › Reinforcement learning › reward learning › reward modeling
reward model evaluation
0.312026
AURORA: Automated Training Framework of Universal Process Reward Models via Ensemble Prompting and Reverse Verification · KDD (1) 2026

Methods — techniques the papers use, named apart from their topics

reinforcement learning · 1.9two-level policy · 1.0reverse verification · 1.0progressive perception · 1.0ensemble prompting · 1.0chain-of-thought · 1.0
YearPublicationVenuePosition
2026 GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
abstract
Recent advances in vision-language models (VLMs) and reinforcement learning (RL) have driven progress in GUI automation. However, most existing methods rely on static, one-shot visual inputs and passive perception, lacking the ability to adaptively determine when, whether, and how to observe the interface. We present GUI-Eyes, a reinforcement learning framework for active visual perception in GUI tasks. To acquire more informative observations, the agent learns to make strategic decisions on both whether and how to invoke visual tools, such as cropping or zooming, within a two-stage reasoning process. To support this behavior, we introduce a progressive perception strategy that decomposes the decision-making into coarse exploration and fine-grained grounding, coordinated by a two-level policy. In addition, we design a spatially continuous reward function tailored to tool usage, which integrates both location proximity and region overlap to provide dense supervision and alleviate the reward sparsity common in GUI environments. On the ScreenSpot-Pro benchmark, GUI-Eyes-3B achieves 44.8% grounding accuracy using only 3k labeled samples, significantly outperforming both supervised and RL-based baselines. These results highlight that tool-aware active perception, enabled by staged policy reasoning and fine-grained reward feedback, is critical for building robust and data-efficient GUI agents.
Jiawei Shao, Dakuan Lu, Haoyi Hu, Xiangcheng Liu, Hantao Yao, Wu Liu 0005
AAAI3
2026 AURORA: Automated Training Framework of Universal Process Reward Models via Ensemble Prompting and Reverse Verification
abstract
The reasoning capabilities of advanced large language models (LLMs) like o1 have revolutionized artificial intelligence applications. Nevertheless, evaluating and optimizing complex reasoning processes remain significant challenges due to diverse policy distributions and the inherent limitations of human effort and accuracy. In this paper, we present AURORA, a novel automated framework for training universal process reward models (PRMs) using ensemble prompting and reverse verification. The framework employs a two-phase approach: First, it uses diverse prompting strategies and ensemble methods to perform automated annotation and evaluation of processes, ensuring robust assessments for reward learning. Second, it leverages practical reference answers for reverse verification, enhancing the model's ability to validate outputs and improving training accuracy. To assess the framework's performance, we extend beyond the existing ProcessBench benchmark by introducing UniversalBench, which evaluates reward predictions across full trajectories under diverse policy distribtion with long Chain-of-Thought (CoT) outputs. Experimental results demonstrate that AURORA enhances process evaluation accuracy, improves PRMs' accuracy for diverse policy distributions and long-CoT responses.
Xiaoyu Tan, Tianchu Yao, Chao Qu, Bin Li 0091, Dakuan Lu, Haozhe Wang 0002, Yinghui Xu 0001, Xihe Qiu
KDD (1)6
2025 ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraints
abstract
Spatial reasoning is a key capability in the field of artificial intelligence, especially crucial in areas such as robotics, computer vision, and natural language understanding. However, evaluating the ability of multimodal large language models (MLLMs) in complex spatial reasoning still faces challenges, particularly in scenarios requiring multi-step reasoning and precise mathematical constraints. This paper introduces ORIGAMISPACE, a new dataset and benchmark designed to evaluate the multi-step spatial reasoning ability and the capacity to handle mathematical constraints of MLLMs through origami tasks. The dataset contains 350 data instances, each comprising a strictly formatted crease pattern (CP diagram), the Compiled Flat Pattern, the complete Folding Process, and the final Folded Shape Image. We propose four evaluation tasks: Pattern Prediction, Multi-step Spatial Reasoning, Spatial Relationship Prediction, and End-to-End CP Code Generation. For the CP code generation task, we design an interactive environment and explore the possibility of using reinforcement learning methods to train MLLMs. Through experiments on existing MLLMs, we initially reveal the strengths and weaknesses of these models in handling complex spatial reasoning tasks.
Rui Xu 0026, Dakuan Lu, Zicheng Zhao, Xiaoyu Tan, Xintao Wang 0001, Jiangjie Chen, Yinghui Xu 0001
NeurIPS2
2024 Source Prompt: Coordinated Pre-training of Language Models on Diverse Corpora from Multiple Sources
abstract
Pre-trained language models (PLMs) have established the new paradigm in the field of NLP. For more powerful PLMs, one of the most popular and successful ways is to continuously scale up sizes of the models and the pre-training corpora. These large corpora, typically obtained by converging smaller ones from multiple sources, are thus growing increasingly diverse. However, colossal converged corpora don't always enhance PLMs' performance. In this paper, we identify the disadvantage of heterogeneous corpora from multiple sources for pre-training PLMs. Towards coordinated pre-training on diverse corpora, we further propose Source Prompt (SP), which explicitly prompt the model with the source of data at the pre-training and fine-tuning stages. Extensive experimental results show that pre-training PLMs with SP on diverse corpora significantly improves performance in various downstream tasks.
Yipei Xu, Dakuan Lu, Jiaqing Liang, Jin Zhao 0004, Xintao Wang 0001, Hengkui Wu, Liujiang Liu, Yingsi Xin, Xuepeng Liu, Yanghua Xiao, Zhixu Li
CIKM2