Demo Data from SIGIR 2026 / reviewers in the wild / expert
S. M. Rashidul Hasan Nijhum
dblp:420/7520
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021Human-computer interaction and ubiquitous computing · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Software engineering, system software, and programming languages
1 paper |
Empirical software engineering · 100% | |
| Computer graphics and multimedia
1 paper |
Virtual and augmented reality · 100% |
Topics — the 2 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Empirical software engineering › reproducibility
replication study |
0.9 | 1 | 2025 | The State of Replication at IEEE ISMAR and IEEE VR: A Scoping Literature Review (2010 - 2024) and Online Survey · ISMAR 2025 |
Empirical software engineering
mining software repositories |
0.3 | 1 | 2025 | The State of Replication at IEEE ISMAR and IEEE VR: A Scoping Literature Review (2010 - 2024) and Online Survey · ISMAR 2025 |
Methods — techniques the papers use, named apart from their topics
scoping literature review · 1.7online survey · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | The State of Replication at IEEE ISMAR and IEEE VR: A Scoping Literature Review (2010 - 2024) and Online SurveyabstractA replication attempts to confirm outcomes of earlier research, which is critical in validating and generalizing scientific findings. Yet, its prevalence and practices remain underexplored in Augmented and Virtual Reality (AR/VR) research. To address this, we present a scoping literature review of replication studies within IEEE ISMAR and IEEE VR, spanning 15 years from 2010 to 2024. Our analysis revealed that replication in AR/VR research is rare. Of 2167 total papers reviewed, less than 4 % were identified as replication studies. Of these, conceptual replications were the predominant type (57 %). Most of those were studies in VR (67 %) and within-subject designs (66 %). Complementing the literature survey results, we conducted an online survey with 61 participants about their experiences with replication studies and found that 39 % of them had conducted a replication study. However, limited resources and external motivation hamper the execution of replication studies among these AR/VR researchers. Combining the findings from our literature review and online survey, we discuss the current state of replication research and the factors contributing to its infrequency. We provide recommendations to improve AR/VR research replication practices, focusing on research culture and reporting, and discuss ongoing challenges. Mohammed Safayet Arefin, Verena Biener, S. M. Rashidul Hasan Nijhum, Florian Weidner, Jens Grubert, J. Edward Swan II |
ISMAR | 3 |