Demo Data from EDBT 2026 / reviewers in the wild / expert
Flemming Kondrup
dblp:330/3902
· DBLP profile ↗
2ranked-venue papers
1as first author
2since 2021 · last 2026
0000-0002-4615-4190ORCID · corroborated
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 1 first-author · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-author · 2 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
2 papers |
Reinforcement learning · 100% | |
| Interdisciplinary, comprehensive, and emerging computing
2 papers |
Medical and health informatics · 100% |
Topics — the 6 heaviest of 6, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Machine learning › Reinforcement learning
model-based reinforcement learning |
1.0 | 1 | 2026 | Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study · AAAI 2026 |
Machine learning › Reinforcement learning
transfer learning in reinforcement learning |
1.0 | 1 | 2026 | Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study · AAAI 2026 |
Machine learning › Reinforcement learning › offline reinforcement learning
conservative q-learning |
0.7 | 1 | 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023 |
Machine learning › Reinforcement learning
offline reinforcement learning |
0.7 | 1 | 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023 |
Medical and health informatics › digital health
diabetes management |
0.3 | 1 | 2026 | Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study · AAAI 2026 |
Medical and health informatics
mechanical ventilation treatment |
0.2 | 1 | 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023 |
Methods — techniques the papers use, named apart from their topics
model-based planning · 2.0deep dyna-q · 2.0LSTM · 2.0reward shaping · 1.3fitted q-evaluation · 0.7fitted q evaluation · 0.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico StudyabstractPersonalized insulin therapy for individuals with Type 1 Diabetes via closed‑loop artificial pancreas systems requires rapid adaptation of dosing strategies to each patient's unique insulin response. However, learning patient‑specific policies from scratch demands extensive exploration, which is often impractical. In this work, we study a framework that integrates insulin-response-informed transfer learning with model-based reinforcement learning for insulin dosing. We first train an LSTM‑based insulin responsiveness predictor on virtual patients, using their glucose, insulin, and meal history to forecast future glucose levels. Analysis of insulin responsiveness of in-silico patients uncovers natural insulin‑response groups characterized by similar sensitivity and dynamics profiles. For a new patient, we identify a representative model from their response group and use it to generate synthetic trajectories. These trajectories are integrated into an enhanced H-step Deep Dyna-Q algorithm, enabling accelerated policy optimization through model-based planning. The dynamics model trained entirely in simulation achieves 91.31% accuracy in predicting blood glucose ranges on the Ohio Type 1 Diabetes dataset, indicating strong zero-shot generalization. Additionally, we find that bootstrapping a new patient with a physiologically-matched reference model accelerates convergence of effective dosing policies across in-silico cohorts of children, adolescents, and adults. These findings suggest that leveraging response-group-specific synthetic experience can expedite personalized insulin therapy, offering a promising pathway towards clinical validation. Sumana Basu, Flemming Kondrup, Adriana Romero-Soriano, Doina Precup |
AAAI | 2 |
| 2023 | Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement LearningabstractMechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would be beneficial to develop an automated decision support tool to optimize ventilation treatment. We present DeepVent, a Conservative Q-Learning (CQL) based offline Deep Reinforcement Learning (DRL) agent that learns to predict the optimal ventilator parameters for a patient to promote 90 day survival. We design a clinically relevant intermediate reward that encourages continuous improvement of the patient vitals as well as addresses the challenge of sparse reward in RL. We find that DeepVent recommends ventilation parameters within safe ranges, as outlined in recent clinical trials. The CQL algorithm offers additional safety by mitigating the overestimation of the value estimates of out-of-distribution states/actions. We evaluate our agent using Fitted Q Evaluation (FQE) and demonstrate that it outperforms physicians from the MIMIC-III dataset. Flemming Kondrup, Thomas Jiralerspong, Elaine Lau, Nathan de Lara, Jacob Shkrob, My Duc Tran, Doina Precup, Sumana Basu |
AAAI | 1 |