EDBT 2026 Demo / reviewers in the wild / expert
Raphael Noemmer
dblp:256/4417 · also Raphael Nömmer
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2024
0000-0003-2864-3326ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Software engineering, systems software and programming languages · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
1 paper |
Software testing · 87% Empirical software engineering · 13% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Software testing
test optimization |
0.8 | 1 | 2024 | Optimization of Automated and Manual Software Tests in Industrial Practice: A Survey and Historical Analysis · IEEE Trans. Software Eng. 2024 |
Software testing › regression testing
test suite reduction |
0.8 | 1 | 2024 | Optimization of Automated and Manual Software Tests in Industrial Practice: A Survey and Historical Analysis · IEEE Trans. Software Eng. 2024 |
Empirical software engineering › software engineering research methodology
industrial case study |
0.2 | 1 | 2024 | Optimization of Automated and Manual Software Tests in Industrial Practice: A Survey and Historical Analysis · IEEE Trans. Software Eng. 2024 |
Methods — techniques the papers use, named apart from their topics
test impact analysis · 0.8pareto testing · 0.8cost-benefit analysis · 0.8
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Optimization of Automated and Manual Software Tests in Industrial Practice: A Survey and Historical AnalysisabstractContext: Both automated and manual software testing are widely applied in practice. While being essential for project success and software quality, they are very resource-intensive, thus motivating the pursuit for optimization.Goal: We aim at understanding to what extent test optimization techniques forautomatedtesting from the field of test case selection, prioritization, and test suite minimization can be applied tomanualtesting processes in practice.Method: We have studied the automated and manual testing process of five industrial study subjects from five different domains with different technological backgrounds and assessed the costs and benefits of test optimization techniques in industrial practice. In particular, we have carried out a cost–benefit analysis of two language-agnostic optimization techniques (test impact analysis and Pareto testing a technique we introduce in this paper) on 2,622 real-world failures from our subject's histories.Results: Both techniques maintain most of the fault detection capability while significantly reducing the test runtime. For automated testing, optimized test suites detect, on average, 80% of failures, while saving 66% of execution time, as compared to 81% failure detection rate for manual test suites and an average time saving of 43%. We observe an average speedup of the time to first failure of around 49 compared to a random test ordering.Conclusion: Our results suggest that optimization techniques from automated testing can be transferred to manual testing in industrial practice, resulting in lower test execution time and much lower time-to-feedback, but coming with process-related limitations and requirements for a successful implementation. All study subjects implemented one of our test optimization techniques in their processes, which demonstrates the practical impact of our findings. Roman Haas, Raphael Noemmer, Elmar Jürgens, Sven Apel |
IEEE Trans. Software Eng. | 2 |