Demo Data from EDBT 2026 / reviewers in the wild / expert
Elsie Nallipogu
dblp:55/2351
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
1 paper |
Debugging and program repair · 33% Software maintenance and evolution · 33% Software testing · 33% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Debugging and program repair
automated program repair |
0.9 | 1 | 2025 | SWE-bench Goes Live! · NeurIPS 2025 |
Software testing › test infrastructure
benchmark construction |
0.9 | 1 | 2025 | SWE-bench Goes Live! · NeurIPS 2025 |
Software maintenance and evolution › issue management
issue resolution |
0.9 | 1 | 2025 | SWE-bench Goes Live! · NeurIPS 2025 |
Methods — techniques the papers use, named apart from their topics
large language model · 0.9agent framework · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | SWE-bench Goes Live!abstractThe issue-resolving task, where a model generates patches to fix real-world bugs, has emerged as a key benchmark for evaluating the capabilities of large language models (LLMs). While SWE-bench has become the dominant benchmark in this domain, it suffers from several limitations: it has not been updated since its release, is restricted to only 12 repositories, and relies heavily on manual effort for constructing test instances and setting up executable environments, significantly limiting its scalability. We present SWE-bench-Live, a live-updatable benchmark designed to address these limitations. SWE-bench-Live currently includes 1,890 tasks derived from real GitHub issues created since 2024, spanning 223 repositories. Each task is accompanied by a dedicated Docker image to ensure reproducible execution. Additionally, we introduce an automated curation pipeline that streamlines the entire process from instance creation to environment setup, removing manual bottlenecks and enabling scalability and continuous updates. We evaluate a range of state-of-the-art models and agent frameworks on SWE-bench-Live, offering detailed empirical insights into their real-world bug-fixing capabilities. By providing a fresh, diverse, and executable benchmark grounded in live repository activity, SWE-bench-Live supports reliable, large-scale assessment of code LLMs and code agents in realistic development settings. Linghao Zhang, Shilin He, Chaoyun Zhang, Yu Kang 0006, Bowen Li 0002, Chengxing Xie, Maoquan Wang, Yufan Huang, Shengyu Fu, Elsie Nallipogu, Qingwei Lin, Yingnong Dang, Saravan Rajmohan, Dongmei Zhang 0001 |
NeurIPS | 11 |