Demo Data from SIGIR 2026 / reviewers in the wild / expert
Deric Pang
dblp:200/1120
· DBLP profile ↗
1ranked-venue papers
0as first author
0since 2021 · last 2017
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Software engineering, systems software and programming languages · 1
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
1 paper |
Debugging and program repair · 76% Empirical software engineering · 19% Software testing · 6% |
Topics — the 6 heaviest of 6, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Debugging and program repair
fault localization |
0.3 | 1 | 2017 | Evaluating and improving fault localization · ICSE 2017 |
Debugging and program repair › fault localization
fault localization evaluation |
0.3 | 1 | 2017 | Evaluating and improving fault localization · ICSE 2017 |
Debugging and program repair › fault localization
mutation-based fault localization |
0.3 | 1 | 2017 | Evaluating and improving fault localization · ICSE 2017 |
Empirical software engineering › reproducibility
replication study |
0.3 | 1 | 2017 | Evaluating and improving fault localization · ICSE 2017 |
Debugging and program repair › fault localization
spectrum-based fault localization |
0.3 | 1 | 2017 | Evaluating and improving fault localization · ICSE 2017 |
Software testing
mutation testing |
0.1 | 1 | 2017 | Evaluating and improving fault localization · ICSE 2017 |
Methods — techniques the papers use, named apart from their topics
replication study · 0.3effect size analysis · 0.3
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2017 | Evaluating and improving fault localizationabstractMost fault localization techniques take as input a faulty program, and produce as output a ranked list of suspicious code locations at which the program may be defective. When researchers propose a new fault localization technique, they typically evaluate it on programs with known faults. The technique is scored based on where in its output list the defective code appears. This enables the comparison of multiple fault localization techniques to determine which one is better. Previous research has evaluated fault localization techniques using artificial faults, generated either by mutation tools or manually. In other words, previous research has determined which fault localization techniques are best at finding artificial faults. However, it is not known which fault localization techniques are best at finding real faults. It is not obvious that the answer is the same, given previous work showing that artificial faults have both similarities to and differences from real faults. We performed a replication study to evaluate 10 claims in the literature that compared fault localization techniques (from the spectrum-based and mutation-based families). We used 2995 artificial faults in 6 real-world programs. Our results support 7 of the previous claims as statistically significant, but only 3 as having non-negligible effect sizes. Then, we evaluated the same 10 claims, using 310 real faults from the 6 programs. Every previous result was refuted or was statistically and practically insignificant. Our experiments show that artificial faults are not useful for predicting which fault localization techniques perform best on real faults. In light of these results, we identified a design space that includes many previously-studied fault localization techniques as well as hundreds of new techniques. We experimentally determined which factors in the design space are most important, using an overall set of 395 real faults. Then, we extended this design space with new techniques. Several of our novel techniques outperform all existing techniques, notably in terms of ranking defective code in the top-5 or top-10 reports. Spencer Pearson, José Campos 0001, René Just, Gordon Fraser 0001, Rui Abreu 0001, Michael D. Ernst, Deric Pang, Benjamin Keller |
ICSE | 7 |