Demo Data from SIGIR 2026 / reviewers in the wild / expert
Radin Cheraghi
dblp:405/3569
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
0009-0006-0887-2614ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Trustworthy machine learning · 50% Information extraction and text analysis · 50% | |
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 3 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Information extraction and text analysis › text mining › authorship analysis
authorship attribution |
1.0 | 1 | 2026 | PeerPrism: Peer Evaluation Expertise vs Review-writing AI · SIGIR 2026 |
Machine learning › Trustworthy machine learning
interpretability |
1.0 | 1 | 2026 | PeerPrism: Peer Evaluation Expertise vs Review-writing AI · SIGIR 2026 |
Information retrieval › text analysis
AI-generated text detection |
1.0 | 1 | 2026 | PeerPrism: Peer Evaluation Expertise vs Review-writing AI · SIGIR 2026 |
Methods — techniques the papers use, named apart from their topics
text detection · 2.0large language model · 2.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | PeerPrism: Peer Evaluation Expertise vs Review-writing AIabstractLarge Language Models (LLMs) are increasingly used in scientific peer review, assisting with drafting, rewriting, and refinement. However, existing peer-review LLM detection methods largely treat authorship as a binary problem (human vs. AI) without accounting for the hybrid nature of modern review workflows. In practice, evaluative ideas and surface realization may originate from different sources, creating a spectrum of human-AI collaboration. To address this, we introduce PeerPrism, a large-scale benchmark of 20,690 peer reviews explicitly designed to disentangle idea provenance from text provenance. We construct controlled generation regimes spanning fully human, fully synthetic, and multiple hybrid transformations. We benchmark state-of-the-art LLM text detection methods on PeerPrism. While several methods achieve high accuracy on the standard binary task, their predictions diverge sharply under hybrid regimes. In particular, when ideas originate from humans but the surface text is AI-generated, detectors frequently disagree and produce contradictory classifications. Our results show that current detection methods conflate surface realization with intellectual contribution. Rather than relying on this binary, authorship must be modeled as a multidimensional construct spanning semantic reasoning and stylistic realization. PeerPrism is the first benchmark evaluating human-AI collaboration in these settings. We release all code, data, prompts, and evaluation scripts to facilitate reproducible research at https://github.com/Reviewerly-Inc/PeerPrism. Soroush Sadeghian, Alireza DaghighFarsoodeh, Radin Cheraghi, Sajad Ebrahimi 0001, Negar Arabzadeh, Ebrahim Bagheri |
SIGIR | 3 |