Demo Data from SIGIR 2026 / reviewers in the wild / expert
Yash Mundhra
dblp:417/7337
· DBLP profile ↗
1ranked-venue papers
1as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Software engineering, systems software and programming languages · 1 · 1 first-author · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
1 paper |
Program synthesis and code generation · 44% Empirical software engineering · 44% Software maintenance and evolution · 13% |
Topics — the 2 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Program synthesis and code generation
code generation with language models |
0.9 | 1 | 2025 | Evaluating Large Language Models for Functional and Maintainable Code in Industrial Settings: A Case Study at ASML · ASE 2025 |
Empirical software engineering › software engineering research methodology
industrial case study |
0.9 | 1 | 2025 | Evaluating Large Language Models for Functional and Maintainable Code in Industrial Settings: A Case Study at ASML · ASE 2025 |
Methods — techniques the papers use, named apart from their topics
large language model · 0.9few-shot prompting · 0.9chain-of-thought prompting · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Evaluating Large Language Models for Functional and Maintainable Code in Industrial Settings: A Case Study at ASMLabstractLarge language models have shown impressive performance in various domains, including code generation across diverse open-source domains. However, their applicability in proprietary industrial settings, where domain-specific constraints and code interdependencies are prevalent, remains largely unexplored. We present a case study conducted in collaboration with the leveling department at ASML to investigate the performance of LLMs in generating functional, maintainable code within a closed, highly specialized software environment.We developed an evaluation framework tailored to ASML’s proprietary codebase and introduced a new benchmark. Additionally, we proposed a new evaluation metric, build@k, to assess whether LLM-generated code successfully compiles and integrates within real industrial repositories. We investigate various prompting techniques, compare the performance of generic and code-specific LLMs, and examine the impact of model size on code generation capabilities, using both match-based and execution-based metrics. The findings reveal that prompting techniques and model size have a significant impact on output quality, with few-shot and chain-of-thought prompting yielding the highest build success rates. The difference in performance between the code-specific LLMs and generic LLMs was less pronounced and varied substantially across different model families. Yash Mundhra, Max Valk, Maliheh Izadi |
ASE | 1 |