Demo Data from VLDB 2026 / reviewers in the wild / expert
Guillaume Saint-Jacques
dblp:172/6893
· DBLP profile ↗
1ranked-venue papers
0as first author
0since 2021 · last 2017
—ORCID · unresolved
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1Databases, data management, data science and information retrieval · 1
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Computational social science and digital humanities · 100% | |
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computational social science and digital humanities
causal inference |
0.3 | 1 | 2017 | Detecting Network Effects: Randomizing Over Randomized Experiments · KDD 2017 |
Computational social science and digital humanities › causal inference
randomized controlled trial |
0.3 | 1 | 2017 | Detecting Network Effects: Randomizing Over Randomized Experiments · KDD 2017 |
Information retrieval › evaluation › online evaluation
a/b testing |
0.1 | 1 | 2017 | Detecting Network Effects: Randomizing Over Randomized Experiments · KDD 2017 |
Methods — techniques the papers use, named apart from their topics
statistical hypothesis testing · 0.6randomized experimental design · 0.6
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2017 | Detecting Network Effects: Randomizing Over Randomized ExperimentsabstractRandomized experiments, or A/B tests, are the standard approach for evaluating the causal effects of new product features, i.e., treatments. The validity of these tests rests on the "stable unit treatment value assumption" (SUTVA), which implies that the treatment only affects the behavior of treated users, and does not affect the behavior of their connections. Violations of SUTVA, common in features that exhibit network effects, result in inaccurate estimates of the causal effect of treatment. In this paper, we leverage a new experimental design for testing whether SUTVA holds, without making any assumptions on how treatment effects may spill over between the treatment and the control group. To achieve this, we simultaneously run both a completely randomized and a cluster-based randomized experiment, and then we compare the difference of the resulting estimates. We present a statistical test for measuring the significance of this difference and offer theoretical bounds on the Type I error rate. We provide practical guidelines for implementing our methodology on large-scale experimentation platforms. Importantly, the proposed methodology can be applied to settings in which a network is not necessarily observed but, if available, can be used in the analysis. Finally, we deploy this design to LinkedIn's experimentation platform and apply it to two online experiments, highlighting the presence of network effects and bias in standard A/B testing approaches in a real-world setting. Martin Saveski, Jean Pouget-Abadie, Guillaume Saint-Jacques, Weitao Duan, Ya Xu, Edoardo M. Airoldi |
KDD | 3 |