Demo Data from VLDB 2026 / reviewers in the wild / expert
Matt Witheridge
dblp:295/1206
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2021
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Software engineering, systems software and programming languages · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
1 paper |
Software testing · 87% Empirical software engineering · 13% |
Topics — the 2 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Software testing › metamorphic testing
metamorphic relations |
0.5 | 1 | 2021 | Metamorphic Robustness Testing: Exposing Hidden Defects in Citation Statistics and Journal Impact Factors · IEEE Trans. Software Eng. 2021 |
Software testing
metamorphic testing |
0.5 | 1 | 2021 | Metamorphic Robustness Testing: Exposing Hidden Defects in Citation Statistics and Journal Impact Factors · IEEE Trans. Software Eng. 2021 |
Methods — techniques the papers use, named apart from their topics
metamorphic testing · 0.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2021 | Metamorphic Robustness Testing: Exposing Hidden Defects in Citation Statistics and Journal Impact FactorsabstractWe propose a robustness testing approach for software systems that process large amounts of data. Our method uses metamorphic relations to check software output for erroneous input in the absence of a tangible test oracle. We use this technique to test two major citation database systems: Scopus and the Web of Science. We report a surprising finding that the inclusion of hyphens in paper titles impedes citation counts, and that this is a result of the lack of robustness of the citation database systems in handling hyphenated paper titles. Our results are valid for the entire literature as well as for individual fields such as chemistry. We further find a strong and significant negative correlation between the journal impact factor (JIF) of IEEE Transactions on Software Engineering (TSE) and the percentage of hyphenated paper titles published in TSE. Similar results are found for ACM Transactions on Software Engineering and Methodology. A software engineering field-wide study reveals that the higher JIF-ranked journals are publishing a lower percentage of papers with hyphenated titles. Our results challenge the common belief that citation counts and JIFs are reliable measures of the impact of papers and journals, as they can be distorted simply by the presence of hyphens in paper titles. Zhiquan Zhou 0001, T. H. Tse, Matt Witheridge |
IEEE Trans. Software Eng. | 3 |