Demo Data from EDBT 2026 / reviewers in the wild / expert
Mart Bakler
dblp:401/8885
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Planning, search and constraint satisfaction · 44% Language models and text generation · 44% Knowledge representation and reasoning · 13% | |
| Software engineering, system software, and programming languages
1 paper |
Program synthesis and code generation · 100% |
Topics — the 3 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
LLM agents |
0.9 | 1 | 2025 | Factorio Learning Environment · NeurIPS 2025 |
Knowledge, reasoning and agents › Planning, search and constraint satisfaction › planning
long-term planning |
0.9 | 1 | 2025 | Factorio Learning Environment · NeurIPS 2025 |
Knowledge, reasoning and agents › Knowledge representation and reasoning
spatial reasoning |
0.3 | 1 | 2025 | Factorio Learning Environment · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
large language model · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Factorio Learning EnvironmentabstractLarge Language Models (LLMs) are rapidly saturating existing benchmarks, necessitating new open-ended evaluations. We introduce the Factorio Learning Environment (FLE), based on the game of Factorio, that tests agents in long-term planning, spatial reasoning, program synthesis, and resource optimization. FLE provides exponentially scaling challenges -- from basic automation to complex factories processing millions of resource units per second. We provide two settings: (1) open-play with the open-ended task of building the largest factory on an procedurally generated map and (2) lab-play consisting of 33 bounded tasks accross three settings with fixed resources. We demonstrate across both settings that models still lack strong spatial reasoning. In lab-play, we find that LLMs exhibit promising short-horizon skills, yet are unable to operate effectively in constrained environments, reflecting limitations in error analysis. In open-play, while LLMs discover automation strategies that improve growth (e.g electric-powered drilling), they fail to achieve complex automation (e.g electronic-circuit manufacturing) Jack Hopkins, Mart Bakler, Akbir Khan |
NeurIPS | 2 |