Demo Data from SIGIR 2026 / reviewers in the wild / expert
Caiyu Hu
dblp:368/3423
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 62% Planning, search and constraint satisfaction · 38% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
LLM agents |
0.8 | 1 | 2024 | TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation · ACL (1) 2024 |
Knowledge, reasoning and agents › Planning, search and constraint satisfaction
temporal planning |
0.2 | 1 | 2024 | TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation · ACL (1) 2024 |
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › temporal planning
time-dependent planning |
0.2 | 1 | 2024 | TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation · ACL (1) 2024 |
Methods — techniques the papers use, named apart from their topics
textual simulation · 0.8large language model · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware SimulationabstractDespite remarkable advancements in emulating human-like behavior through Large Language Models (LLMs), current textual simulations do not adequately address the notion of time.To this end, we introduce TIMEARENA, a novel textual simulated environment that incorporates complex temporal dynamics and constraints that better reflect real-life planning scenarios.In TIMEARENA, agents are asked to complete multiple tasks as soon as possible, allowing for parallel processing to save time.We implement the dependency between actions, the time duration for each action, and the occupancy of the agent and the objects in the environment.TIMEARENA grounds to 30 real-world tasks in cooking, household activity, and laboratory work.We conduct extensive experiments with various LLMs using TIMEARENA.Our findings reveal that even the most powerful models, e.g., GPT-4, still lag behind humans in effective multitasking, underscoring the need for enhanced temporal awareness in the development of language agents. 1 Yikai Zhang 0004, Caiyu Hu, Kyle Richardson 0001, Yanghua Xiao, Jiangjie Chen |
ACL (1) | 3 |