Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Flemming Kondrup

dblp:330/3902 · DBLP profile ↗
← Back
2ranked-venue papers
1as first author
2since 2021 · last 2026
0000-0002-4615-4190ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 1 first-author · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 first-author · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
2 papers
Reinforcement learning · 100%
Interdisciplinary, comprehensive, and emerging computing
2 papers
Medical and health informatics · 100%

Topics — the 6 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Reinforcement learning
model-based reinforcement learning
1.012026
Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study · AAAI 2026
Machine learning › Reinforcement learning
transfer learning in reinforcement learning
1.012026
Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study · AAAI 2026
Machine learning › Reinforcement learning › offline reinforcement learning
conservative q-learning
0.712023
Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023
Machine learning › Reinforcement learning
offline reinforcement learning
0.712023
Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023
Medical and health informatics › digital health
diabetes management
0.312026
Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study · AAAI 2026
Medical and health informatics
mechanical ventilation treatment
0.212023
Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning · AAAI 2023

Methods — techniques the papers use, named apart from their topics

model-based planning · 2.0deep dyna-q · 2.0LSTM · 2.0reward shaping · 1.3fitted q-evaluation · 0.7fitted q evaluation · 0.7
YearPublicationVenuePosition
2026 Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study
abstract
Personalized insulin therapy for individuals with Type 1 Diabetes via closed‑loop artificial pancreas systems requires rapid adaptation of dosing strategies to each patient's unique insulin response. However, learning patient‑specific policies from scratch demands extensive exploration, which is often impractical. In this work, we study a framework that integrates insulin-response-informed transfer learning with model-based reinforcement learning for insulin dosing. We first train an LSTM‑based insulin responsiveness predictor on virtual patients, using their glucose, insulin, and meal history to forecast future glucose levels. Analysis of insulin responsiveness of in-silico patients uncovers natural insulin‑response groups characterized by similar sensitivity and dynamics profiles. For a new patient, we identify a representative model from their response group and use it to generate synthetic trajectories. These trajectories are integrated into an enhanced H-step Deep Dyna-Q algorithm, enabling accelerated policy optimization through model-based planning. The dynamics model trained entirely in simulation achieves 91.31% accuracy in predicting blood glucose ranges on the Ohio Type 1 Diabetes dataset, indicating strong zero-shot generalization. Additionally, we find that bootstrapping a new patient with a physiologically-matched reference model accelerates convergence of effective dosing policies across in-silico cohorts of children, adolescents, and adults. These findings suggest that leveraging response-group-specific synthetic experience can expedite personalized insulin therapy, offering a promising pathway towards clinical validation.
Sumana Basu, Flemming Kondrup, Adriana Romero-Soriano, Doina Precup
AAAI2
2023 Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning
abstract
Mechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would be beneficial to develop an automated decision support tool to optimize ventilation treatment. We present DeepVent, a Conservative Q-Learning (CQL) based offline Deep Reinforcement Learning (DRL) agent that learns to predict the optimal ventilator parameters for a patient to promote 90 day survival. We design a clinically relevant intermediate reward that encourages continuous improvement of the patient vitals as well as addresses the challenge of sparse reward in RL. We find that DeepVent recommends ventilation parameters within safe ranges, as outlined in recent clinical trials. The CQL algorithm offers additional safety by mitigating the overestimation of the value estimates of out-of-distribution states/actions. We evaluate our agent using Fitted Q Evaluation (FQE) and demonstrate that it outperforms physicians from the MIMIC-III dataset.
Flemming Kondrup, Thomas Jiralerspong, Elaine Lau, Nathan de Lara, Jacob Shkrob, My Duc Tran, Doina Precup, Sumana Basu
AAAI1