Demo Data from VLDB 2026 / reviewers in the wild / expert
Lars Benedikt Kaesberg
dblp:382/4628
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2025
0009-0002-1686-3743ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 39% Planning, search and constraint satisfaction · 30% Knowledge representation and reasoning · 30% |
Topics — the 3 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Knowledge, reasoning and agents › Knowledge representation and reasoning › spatial reasoning
multi-hop spatial reasoning |
0.9 | 1 | 2025 | SPaRC: A Spatial Pathfinding Reasoning Challenge · EMNLP 2025 |
Natural language and speech › Language models and text generation › large language model evaluation
reasoning benchmark |
0.9 | 1 | 2025 | SPaRC: A Spatial Pathfinding Reasoning Challenge · EMNLP 2025 |
Natural language and speech › Language models and text generation
test-time scaling |
0.3 | 1 | 2025 | SPaRC: A Spatial Pathfinding Reasoning Challenge · EMNLP 2025 |
Methods — techniques the papers use, named apart from their topics
test-time compute scaling · 0.9benchmark construction · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | SPaRC: A Spatial Pathfinding Reasoning ChallengeabstractExisting reasoning datasets saturate and fail to test abstract, multi-step problems, especially pathfinding and complex rule constraint satisfaction.We introduce SPaRC (Spatial Pathfinding Reasoning Challenge), a dataset of 1,000 2D grid pathfinding puzzles to evaluate spatial and rule-based reasoning, requiring stepby-step planning with arithmetic and geometric rules.Humans achieve near-perfect accuracy (98.0%; 94.5% on hard puzzles), while the best reasoning models, such as o4-mini, struggle (15.8%; 1.1% on hard puzzles).Models often generate invalid paths (>50% of puzzles for o4-mini), and reasoning tokens reveal they make errors in navigation and spatial logic.Unlike humans, who take longer on hard puzzles, models fail to scale test-time compute with difficulty.Allowing models to make multiple solution attempts improves accuracy, suggesting potential for better spatial reasoning with improved training and efficient test-time scaling methods.SPaRC can be used as a window into models' spatial reasoning limitations and drive research toward new methods that excel in abstract, multi-step problem-solving. Lars Benedikt Kaesberg, Jan Philip Wahle, Terry Ruas, Bela Gipp |
EMNLP | 1 |