Demo Data from EDBT 2026 / reviewers in the wild / expert
Yahu Cong
dblp:257/6116
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
0009-0002-3024-0235ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% | |
| Artificial intelligence
1 paper |
Trustworthy machine learning · 100% |
Topics — the 2 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Information retrieval › evaluation › online evaluation
a/b testing |
0.9 | 1 | 2025 | Reducing Symbiosis Bias through Better A/B Tests of Recommendation Algorithms · WWW 2025 |
Machine learning › Trustworthy machine learning › fairness › algorithmic bias
bias in machine learning |
0.3 | 1 | 2025 | Reducing Symbiosis Bias through Better A/B Tests of Recommendation Algorithms · WWW 2025 |
Methods — techniques the papers use, named apart from their topics
simulation · 1.7cluster randomization · 1.7a/b testing · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | Reducing Symbiosis Bias through Better A/B Tests of Recommendation AlgorithmsabstractIt is increasingly common in digital environments to use A/B tests to compare the performance of recommendation algorithms. However, such experiments often violate the stable unit treatment value assumption (SUTVA), particularly SUTVA's ''no hidden treatments'' assumption, due to the shared data between algorithms being compared. This results in a novel form of bias, which we term ''symbiosis bias,'' where the performance of each algorithm is influenced by the training data generated by its competitor. In this paper, we investigate three experimental designs--cluster-randomized, data-diverted, and user-corpus co-diverted experiments--aimed at mitigating symbiosis bias. We present a theoretical model of symbiosis bias and simulate the impact of each design in dynamic recommendation environments. Our results show that while each design reduces symbiosis bias to some extent, they also introduce new challenges, such as reduced training data in data-diverted experiments. We further validate the existence of symbiosis bias using data from a large-scale A/B test conducted on a global recommender system, demonstrating that symbiosis bias affects treatment effect estimates in the field. Our findings provide actionable insights for researchers and practitioners seeking to design experiments that accurately capture algorithmic performance without bias in treatment effect estimates introduced by shared data. Jennifer Brennan, Yahu Cong, Yiwei Yu, Lina Lin, Yajun Peng, Changping Meng, Ningren Han, Jean Pouget-Abadie, David Holtz |
WWW | 2 |