Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Kevin Liou

dblp:269/4988 · DBLP profile ↗
← Back
1ranked-venue papers
1as first author
0since 2021 · last 2020
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 first-authorTheory of computation · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
1 paper
Performance modeling and evaluation · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Performance modeling and evaluation
online controlled experiments
0.412020
Variance-Weighted Estimators to Improve Sensitivity in Online Experiments · EC 2020
Performance modeling and evaluation › online controlled experiments
treatment effect estimation
0.412020
Variance-Weighted Estimators to Improve Sensitivity in Online Experiments · EC 2020
Performance modeling and evaluation › simulation
variance reduction
0.412020
Variance-Weighted Estimators to Improve Sensitivity in Online Experiments · EC 2020

Methods — techniques the papers use, named apart from their topics

variance-weighted estimator · 0.4pre-experiment data · 0.4coefficient of variation · 0.4
YearPublicationVenuePosition
2020 Variance-Weighted Estimators to Improve Sensitivity in Online Experiments
abstract
As companies increasingly rely on experiments to make product decisions, precisely measuring changes in key metrics is important. Various methods to increase sensitivity in experiments have been proposed, including methods that use pre-experiment data, machine learning, and more advanced experimental designs. However, prior work has not explored modeling heterogeneity in the variance of individual experimental users. We propose a more sensitive treatment effect estimator that relies on estimating the individual variances of experimental users using pre-experiment data. We show that that weighted estimators using individual-level variance estimates can reduce the variance of treatment effect estimates, and prove that the coefficient of variation of the sample population variance is a sufficient statistic for determining the scale of possible variance reduction. We provide empirical results from case studies at Facebook demonstrating the effectiveness of this approach, where the average experiment achieved a 17% reduction in variance with minimal impact on bias.
Kevin Liou, Sean J. Taylor
EC1