Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Arkady Epshteyn

dblp:90/558 · DBLP profile ↗
← Back
5ranked-venue papers
4as first author
0since 2021 · last 2020
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 3 first-authorDatabases, data management, data science and information retrieval · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Interdisciplinary, comprehensive, and emerging computing
1 paper
Medical and health informatics · 100%
Artificial intelligence
3 papers
Reinforcement learning · 57% Trustworthy machine learning · 43%

Topics — the 7 heaviest of 7, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Medical and health informatics › public health › public health informatics
COVID-19 forecasting
0.412020
Interpretable Sequence Learning for Covid-19 Forecasting · NeurIPS 2020
Medical and health informatics
epidemic modeling
0.412020
Interpretable Sequence Learning for Covid-19 Forecasting · NeurIPS 2020
Machine learning › Reinforcement learning
exploration
0.122008
Active reinforcement learning · ICML 2008
Qualitative reinforcement learning · ICML 2006
Machine learning › Reinforcement learning
markov decision process
0.122008
Active reinforcement learning · ICML 2008
Qualitative reinforcement learning · ICML 2006
Machine learning › Trustworthy machine learning › interpretability › explainable AI
explainable prediction
0.112020
Interpretable Sequence Learning for Covid-19 Forecasting · NeurIPS 2020
Machine learning › Trustworthy machine learning
interpretability
0.112020
Interpretable Sequence Learning for Covid-19 Forecasting · NeurIPS 2020
Machine learning › Reinforcement learning › safe reinforcement learning
safe exploration
0.112006
Qualitative reinforcement learning · ICML 2006

Methods — techniques the papers use, named apart from their topics

interpretable encoder · 0.9SEIR model · 0.9policy optimization · 0.1sensitivity analysis · 0.1stochastic dominance constraints · 0.1
YearPublicationVenuePosition
2020 Interpretable Sequence Learning for Covid-19 Forecasting
abstract
We propose a novel approach that integrates machine learning into compartmental disease modeling (e.g., SEIR) to predict the progression of COVID-19. Our model is explainable by design as it explicitly shows how different compartments evolve and it uses interpretable encoders to incorporate covariates and improve performance. Explainability is valuable to ensure that the model's forecasts are credible to epidemiologists and to instill confidence in end-users such as policy makers and healthcare institutions. Our model can be applied at different geographic resolutions, and we demonstrate it for states and counties in the United States. We show that our model provides more accurate forecasts compared to the alternatives, and that it provides qualitatively meaningful explanatory insights.
Sercan Ö. Arik, Chun-Liang Li, Jinsung Yoon, Rajarishi Sinha, Arkady Epshteyn, Long T. Le, Vikas Menon, Shashank Singh 0005, Leyou Zhang, Martin Nikoltchev, Yash Sonthalia, Hootan Nakhost, Elli Kanal, Tomas Pfister
NeurIPS5
2008 Active reinforcement learning
abstract
When the transition probabilities and rewards of a Markov Decision Process (MDP) are known, an agent can obtain the optimal policy without any interaction with the environment. However, exact transition probabilities are difficult for experts to specify. One option left to an agent is a long and potentially costly exploration of the environment. In this paper, we propose another alternative: given initial (possibly inaccurate) specification of the MDP, the agent determines the sensitivity of the optimal policy to changes in transitions and rewards. It then focuses its exploration on the regions of space to which the optimal policy is most sensitive. We show that the proposed exploration strategy performs well on several control and planning problems.
Arkady Epshteyn, Adam Vogel, Gerald DeJong
ICML1
2006 Qualitative reinforcement learning
abstract
When the transition probabilities and rewards of a Markov Decision Process are specified exactly, the problem can be solved without any interaction with the environment. When no such specification is available, the agent's only recourse is a long and potentially dangerous exploration. We present a framework which allows the expert to specify imprecise knowledge of transition probabilities in terms of stochastic dominance constraints. Our algorithm can be used to find optimal policies for qualitatively specified problems, or, when no such solution is available, to decrease the required amount of exploration. The algorithm's behavior is demonstrated on simulations of two classic problems: mountain car ascent and cart pole balancing.
Arkady Epshteyn, Gerald DeJong
ICML1
2006 Generative Prior Knowledge for Discriminative Classification
abstract
We present a novel framework for integrating prior knowledge into discriminative classifiers. Our framework allows discriminative classifiers such as Support Vector Machines (SVMs) to utilize prior knowledge specified in the generative setting. The dual objective of fitting the data and respecting prior knowledge is formulated as a bilevel program, which is solved (approximately) via iterative application of second-order cone programming. To test our approach, we consider the problem of using WordNet (a semantic database of English language) to improve low-sample classification accuracy of newsgroup categorization. WordNet is viewed as an approximate, but readily available source of background knowledge, and our framework is capable of utilizing it in a flexible way.
Arkady Epshteyn, Gerald DeJong
J. Artif. Intell. Res.1
2005 Rotational Prior Knowledge for SVMs
Arkady Epshteyn, Gerald DeJong
ECML1