Demo Data from EDBT 2026 / reviewers in the wild / expert
Benjamin Mudrak
dblp:169/7036
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2021
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 70% Recommender systems · 30% |
Topics — the 4 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Recommender systems
recommender system evaluation |
0.5 | 1 | 2021 | On Estimating Recommendation Evaluation Metrics under Sampling · AAAI 2021 |
Information retrieval › evaluation › evaluation methodology
sampling-based evaluation |
0.5 | 1 | 2021 | On Estimating Recommendation Evaluation Metrics under Sampling · AAAI 2021 |
Information retrieval › evaluation › effectiveness metrics
top-k evaluation metrics |
0.5 | 1 | 2021 | On Estimating Recommendation Evaluation Metrics under Sampling · AAAI 2021 |
Information retrieval
retrieval evaluation |
0.1 | 1 | 2021 | On Estimating Recommendation Evaluation Metrics under Sampling · AAAI 2021 |
Methods — techniques the papers use, named apart from their topics
weighted maximum likelihood estimation · 0.5maximum entropy · 0.5
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2021 | On Estimating Recommendation Evaluation Metrics under SamplingabstractSince the recent studies (KDD'20) done by Krichene and Rendle on the sampling based top-k evaluation metric for recommendation, there have been a lot of debate on the validity of using sampling for evaluating recommendation algorithms. Though their work and the recent work done by Li et. al. (KDD'20) have proposed some basic approach for mapping the sampling based metrics to their counter-part in the global evaluation which uses the entire dataset, there is still lack of understanding how sampling should be used for recommendation evaluation, and the proposed approaches either are rather ad-hoc or can only work on simple metrics, like Recall/Hit-Ratio. In this paper, we introduce some principled approach to derive the estimators of top-k metric based on sampling. Our approaches utilize the weighted MLE and maximal entropy approach to recover the global rank distribution and then utilize that for estimation. The experimental results shows significant advantages of using our approaches for evaluating recommendation algorithms based on top-k metrics. Ruoming Jin, Dong Li 0047, Benjamin Mudrak |
AAAI | 3 |