Demo Data from SIGIR 2026 / reviewers in the wild / expert
Monica Bhole
dblp:281/7149
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2021
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computational social science and digital humanities · 100% | |
| Databases, data mining, and information retrieval
1 paper |
Data mining · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computational social science and digital humanities › online controlled experiments
network experimentation |
0.5 | 1 | 2021 | Network Experimentation at Scale · KDD 2021 |
Computational social science and digital humanities › online controlled experiments
online field experiment |
0.5 | 1 | 2021 | Network Experimentation at Scale · KDD 2021 |
Data mining
causal inference |
0.1 | 1 | 2021 | Network Experimentation at Scale · KDD 2021 |
Methods — techniques the papers use, named apart from their topics
variance reduction · 1.0cluster-based regression adjustment · 1.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2021 | Network Experimentation at ScaleabstractWe describe our network experimentation framework, deployed at Facebook, which accounts for interference between experimental units. We document this system, including the design and estimation procedures, and detail insights we have gained from the many experiments that have used this system at scale. In our estimation procedure, we introduce a cluster-based regression adjustment that substantially improves precision for estimating global treatment effects, as well as a procedure to test for interference. With our regression adjustment, we find that imbalanced clusters can better account for interference than balanced clusters without sacrificing accuracy. In addition, we show that logging exposure to a treatment can result in additional variance reduction. Interference is a widely acknowledged issue in online field experiments, yet there is less evidence from real-world experiments demonstrating interference in online settings. We fill this gap by describing two case studies that capture significant network effects and highlight the value of this experimentation framework. Brian Karrer, Monica Bhole, Tyrone Palmer, Charlie Gelman, Mikael Konutgan |
KDD | 3 |