Demo Data from SIGIR 2026 / reviewers in the wild / expert
Jacob Shkrob
dblp:330/4172
· DBLP profile ↗
2ranked-venue papers
0as first author
2since 2021 · last 2026
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
2 papers |
Reinforcement learning · 82% Probabilistic and Bayesian machine learning · 18% | |
| Theoretical computer science
1 paper |
Mathematical optimization · 100% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Medical and health informatics · 100% |
Topics — the 5 heaviest of 6, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Mathematical optimization › statistical estimation › multivariate estimation
mean estimation |
1.0 | 1 | 2026 | An Empirical Bayes Perspective on Heteroskedastic Mean Estimation · COLT 2026 |
Machine learning › Reinforcement learning › offline reinforcement learning
conservative q-learning |
0.7 | 1 | 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023 |
Machine learning › Reinforcement learning
offline reinforcement learning |
0.7 | 1 | 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023 |
Machine learning › Probabilistic and Bayesian machine learning › statistical inference › bayesian inference
empirical bayes |
0.3 | 1 | 2026 | An Empirical Bayes Perspective on Heteroskedastic Mean Estimation · COLT 2026 |
Medical and health informatics
mechanical ventilation treatment |
0.2 | 1 | 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023 |
Methods — techniques the papers use, named apart from their topics
profile maximum likelihood · 2.0metric entropy bounds · 2.0empirical bayes · 2.0reward shaping · 1.3fitted q-evaluation · 0.7fitted q evaluation · 0.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | An Empirical Bayes Perspective on Heteroskedastic Mean EstimationabstractTowards understanding the fundamental limits of estimation from data of varied quality, we study the problem of estimating a mean parameter from heteroskedastic Gaussian observations where the variances are unknown and may vary across observations. While, with known variances, a simple linear estimator attains the smallest mean squared error, estimation without this knowledge is challenging due to the large number of nuisance parameters. We propose a simple and principled approach based on empirical Bayes: model the observations as if they were i.i.d. from a normal scale mixture and compute the profile maximum likelihood estimator (MLE) for the mean, treating the nonparametric mixing distribution as nuisance. Our result shows that this estimator achieves near-optimal error bounds across various heteroskedastic models in the literature. In particular, for the subset-of-signals problem where an unknown subset of observations has small variance, our estimator adaptively achieves the minimax rate for all signal sizes, including the sharp phase transition, without any tuning parameters. One of our key technical steps is a sharper metric entropy bound for normal scale mixtures, obtained via generalized moment matching and Chebyshev approximation. This approach yields an improved polylogarithmic, rather than polynomial, dependence on problem parameters, which could be of independent interest. Yanjun Han, Abhishek Shetty, Jacob Shkrob |
COLT | 3 |
| 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement LearningabstractMechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would be beneficial to develop an automated decision support tool to optimize ventilation treatment. We present DeepVent, a Conservative Q-Learning (CQL) based offline Deep Reinforcement Learning (DRL) agent that learns to predict the optimal ventilator parameters for a patient to promote 90 day survival. We design a clinically relevant intermediate reward that encourages continuous improvement of the patient vitals as well as addresses the challenge of sparse reward in RL. We find that DeepVent recommends ventilation parameters within safe ranges, as outlined in recent clinical trials. The CQL algorithm offers additional safety by mitigating the overestimation of the value estimates of out-of-distribution states/actions. We evaluate our agent using Fitted Q Evaluation (FQE) and demonstrate that it outperforms physicians from the MIMIC-III dataset. Flemming Kondrup, Thomas Jiralerspong, Elaine Lau, Nathan de Lara, Jacob Shkrob, My Duc Tran, Doina Precup, Sumana Basu |
AAAI | 5 |