Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Jacob Shkrob

dblp:330/4172 · DBLP profile ↗
← Back
2ranked-venue papers
0as first author
2since 2021 · last 2026
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Reinforcement learning · 82% Probabilistic and Bayesian machine learning · 18%
Theoretical computer science
1 paper
Mathematical optimization · 100%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Medical and health informatics · 100%

Topics — the 5 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Mathematical optimization › statistical estimation › multivariate estimation
mean estimation
1.012026
An Empirical Bayes Perspective on Heteroskedastic Mean Estimation · COLT 2026
Machine learning › Reinforcement learning › offline reinforcement learning
conservative q-learning
0.712023
Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023
Machine learning › Reinforcement learning
offline reinforcement learning
0.712023
Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023
Machine learning › Probabilistic and Bayesian machine learning › statistical inference › bayesian inference
empirical bayes
0.312026
An Empirical Bayes Perspective on Heteroskedastic Mean Estimation · COLT 2026
Medical and health informatics
mechanical ventilation treatment
0.212023
Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023

Methods — techniques the papers use, named apart from their topics

profile maximum likelihood · 2.0metric entropy bounds · 2.0empirical bayes · 2.0reward shaping · 1.3fitted q-evaluation · 0.7fitted q evaluation · 0.7
YearPublicationVenuePosition
2026 An Empirical Bayes Perspective on Heteroskedastic Mean Estimation
abstract
Towards understanding the fundamental limits of estimation from data of varied quality, we study the problem of estimating a mean parameter from heteroskedastic Gaussian observations where the variances are unknown and may vary across observations. While, with known variances, a simple linear estimator attains the smallest mean squared error, estimation without this knowledge is challenging due to the large number of nuisance parameters. We propose a simple and principled approach based on empirical Bayes: model the observations as if they were i.i.d. from a normal scale mixture and compute the profile maximum likelihood estimator (MLE) for the mean, treating the nonparametric mixing distribution as nuisance. Our result shows that this estimator achieves near-optimal error bounds across various heteroskedastic models in the literature. In particular, for the subset-of-signals problem where an unknown subset of observations has small variance, our estimator adaptively achieves the minimax rate for all signal sizes, including the sharp phase transition, without any tuning parameters. One of our key technical steps is a sharper metric entropy bound for normal scale mixtures, obtained via generalized moment matching and Chebyshev approximation. This approach yields an improved polylogarithmic, rather than polynomial, dependence on problem parameters, which could be of independent interest.
Yanjun Han, Abhishek Shetty, Jacob Shkrob
COLT3
2023 Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning
abstract
Mechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would be beneficial to develop an automated decision support tool to optimize ventilation treatment. We present DeepVent, a Conservative Q-Learning (CQL) based offline Deep Reinforcement Learning (DRL) agent that learns to predict the optimal ventilator parameters for a patient to promote 90 day survival. We design a clinically relevant intermediate reward that encourages continuous improvement of the patient vitals as well as addresses the challenge of sparse reward in RL. We find that DeepVent recommends ventilation parameters within safe ranges, as outlined in recent clinical trials. The CQL algorithm offers additional safety by mitigating the overestimation of the value estimates of out-of-distribution states/actions. We evaluate our agent using Fitted Q Evaluation (FQE) and demonstrate that it outperforms physicians from the MIMIC-III dataset.
Flemming Kondrup, Thomas Jiralerspong, Elaine Lau, Nathan de Lara, Jacob Shkrob, My Duc Tran, Doina Precup, Sumana Basu
AAAI5