EDBT 2026 Demo / reviewers in the wild / expert
Hrvoje Bogunovic
dblp:05/6420
· DBLP profile ↗
41ranked-venue papers
6as first author
24since 2021 · last 2026
0000-0002-9168-0894ORCID · verified
Domains — the database's venue-derived domains; a paper can count in several
Applied, interdisciplinary, general and emerging computing · 39 · 6 first-author · 23 since 2021Graphics, computer vision, multimedia, augmented reality and games · 16 · 2 first-author · 10 since 2021Artificial intelligence and machine learning · 1 · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | STAGE challenge: Structural-Functional Transition in Glaucoma Assessment
Shiqi Zhou, Yuancong Liang, Huihui Fang, Ziyang Chen 0003, Yong Xia 0001, Chubin Ou, Yubo Tan, Haojie Yin, Chengcheng Feng, Hao Zhou 0030, Hrvoje Bogunovic, Huazhu Fu, Fei Li 0021, Xiulan Zhang, Yanwu Xu 0001 |
Medical Image Anal. | 15 |
| 2026 | SD-RetinaNet: Topologically Constrained Semi-Supervised Retinal Lesion and Layer Segmentation in OCTabstractOptical coherence tomography (OCT) is widely used for diagnosing and monitoring retinal diseases, such as age-related macular degeneration (AMD). The segmentation of biomarkers such as layers and lesions is essential for patient diagnosis and follow-up. Recently, semi-supervised learning has shown promise in improving retinal segmentation performance. However, existing methods often produce anatomically implausible segmentations, fail to effectively model layer-lesion interactions, and lack guarantees on topological correctness. To address these limitations, we propose a novel semi-supervised model that introduces a fully differentiable biomarker topology engine to enforce anatomically correct segmentation of lesions and layers. This enables joint learning with bidirectional influence between layers and lesions, leveraging unlabeled and diverse partially labeled datasets. Our model learns a disentangled representation, separating spatial and style factors. This approach enables more realistic layer segmentations and improves lesion segmentation, while strictly enforcing lesion location in their anatomically plausible positions relative to the segmented layers. We evaluate the proposed model on public and internal datasets of OCT scans and show that it outperforms the current state-of-the-art in both lesion and layer segmentation, while demonstrating the ability to generalize layer segmentation to pathological cases using partially annotated training data. Our results demonstrate the potential of using anatomical constraints in semi-supervised learning for accurate, robust, and trustworthy retinal biomarker segmentation. Botond Fazekas, Guilherme Aresta, Philipp Seeböck, Julia Mai, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
IEEE Trans. Medical Imaging | 6 |
| 2025 | RetFiner: A Vision-Language Refinement Scheme for Retinal Foundation ModelsabstractThe rise of imaging techniques such as optical coherence tomography (OCT) and advances in deep learning (DL) have enabled clinicians and researchers to streamline the assessment of retinal diseases. A popular DL approach is self-supervised learning (SSL), where models learn from vast amounts of unlabeled data, avoiding costly annotation. SSL has allowed the development of foundation models (FMs), large models that can be used for a variety of downstream tasks. However, existing FMs for OCT, trained solely on image data, lack a comprehensive and robust semantic understanding of images, as evidenced by their downstream performance (especially for complex tasks), and thus require supervised fine-tuning (which may be unfeasible) to better adapt to specific applications and populations. To address this, we propose RetFiner, an SSL vision-language refinement scheme that improves the representations of existing FMs and enables their efficient and direct adaptation to specific populations for improved downstream performance. Our method uses a diverse set of training objectives which take advantage of the rich supervisory signal found in textual data. We tested RetFiner on the retinal FMs RETFound, UrFound, and VisionFM, showing significant improvements in linear probing performance on seven highly diverse OCT classification tasks, with an average increase of 5.7, 3.9, and 2.1% points over their baselines, respectively. Ronald Fecso, José Morano, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (5) | 4 |
| 2024 | Forecasting Disease Progression with Parallel Hyperplanes in Longitudinal Retinal OCT
Arunava Chakravarty, Taha Emre, Dmitry A. Lachinov, Antoine Rivail, Hendrik P. N. Scholl, Lars Fritsche, Sobha Sivaprasad, Daniel Rueckert, Andrew J. Lotery, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (5) | 11 |
| 2024 | Learning Temporally Equivariance for Degenerative Disease Progression in OCT by Predicting Future Representations
Taha Emre, Arunava Chakravarty, Dmitry A. Lachinov, Antoine Rivail, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (12) | 6 |
| 2024 | Spatiotemporal Representation Learning for Short and Long Medical Image Time Series
Chengzhi Shen, Martin J. Menten, Hrvoje Bogunovic, Ursula Schmidt-Erfurth, Hendrik P. N. Scholl, Sobha Sivaprasad, Andrew J. Lotery, Daniel Rueckert, Paul Hager, Robbie Holland |
MICCAI (11) | 3 |
| 2024 | RRWNet: Recursive Refinement Network for effective retinal artery/vein segmentation and classificationabstractThe caliber and configuration of retinal blood vessels serve as important biomarkers for various diseases and medical conditions. A thorough analysis of the retinal vasculature requires the segmentation of the blood vessels and their classification into arteries and veins, typically performed on color fundus images obtained by retinography. However, manually performing these tasks is labor-intensive and prone to human error. While several automated methods have been proposed to address this task, the current state of art faces challenges due to manifest classification errors affecting the topological consistency of segmentation maps. In this work, we introduce RRWNet, a novel end-to-end deep learning framework that addresses this limitation. The framework consists of a fully convolutional neural network that recursively refines semantic segmentation maps, correcting manifest classification errors and thus improving topological consistency. In particular, RRWNet is composed of two specialized subnetworks: a Base subnetwork that generates base segmentation maps from the input images, and a Recursive Refinement subnetwork that iteratively and recursively improves these maps. Evaluation on three different public datasets demonstrates the state-of-the-art performance of the proposed method, yielding more topologically consistent segmentation maps with fewer manifest classification errors than existing approaches. In addition, the Recursive Refinement module within RRWNet proves effective in post-processing segmentation maps from other methods, further demonstrating its potential. The model code, weights, and predictions will be publicly available at https://github.com/j-morano/rrwnet. José Morano, Guilherme Aresta, Hrvoje Bogunovic |
Expert Syst. Appl. | 3 |
| 2024 | Metadata-enhanced contrastive learning from retinal optical coherence tomography imagesabstractDeep learning has potential to automate screening, monitoring and grading of disease in medical images. Pretraining with contrastive learning enables models to extract robust and generalisable features from natural image datasets, facilitating label-efficient downstream image analysis. However, the direct application of conventional contrastive methods to medical datasets introduces two domain-specific issues. Firstly, several image transformations which have been shown to be crucial for effective contrastive learning do not translate from the natural image to the medical image domain. Secondly, the assumption made by conventional methods, that any two images are dissimilar, is systematically misleading in medical datasets depicting the same anatomy and disease. This is exacerbated in longitudinal image datasets that repeatedly image the same patient cohort to monitor their disease progression over time. In this paper we tackle these issues by extending conventional contrastive frameworks with a novel metadata-enhanced strategy. Our approach employs widely available patient metadata to approximate the true set of inter-image contrastive relationships. To this end we employ records for patient identity, eye position (i.e. left or right) and time series information. In experiments using two large longitudinal datasets containing 170,427 retinal optical coherence tomography (OCT) images of 7912 patients with age-related macular degeneration (AMD), we evaluate the utility of using metadata to incorporate the temporal dynamics of disease progression into pretraining. Our metadata-enhanced approach outperforms both standard contrastive methods and a retinal image foundation model in five out of six image-level downstream tasks related to AMD. We find benefits in both a low-data and high-data regime across tasks ranging from AMD stage and type classification to prediction of visual acuity. Due to its modularity, our method can be quickly and cost-effectively tested to establish the potential benefits of including available metadata in contrastive pretraining. Robbie Holland, Oliver Leingang, Hrvoje Bogunovic, Sophie Riedl 0001, Lars Fritsche, Toby Prevost, Hendrik P. N. Scholl, Ursula Schmidt-Erfurth, Sobha Sivaprasad, Andrew J. Lotery, Daniel Rueckert, Martin J. Menten |
Medical Image Anal. | 3 |
| 2024 | Anomaly guided segmentation: Introducing semantic context for lesion segmentation in retinal OCT using weak context supervision from anomaly detectionabstractAutomated lesion detection in retinal optical coherence tomography (OCT) scans has shown promise for several clinical applications, including diagnosis, monitoring and guidance of treatment decisions. However, segmentation models still struggle to achieve the desired results for some complex lesions or datasets that commonly occur in real-world, e.g. due to variability of lesion phenotypes, image quality or disease appearance. While several techniques have been proposed to improve them, one line of research that has not yet been investigated is the incorporation of additional semantic context through the application of anomaly detection models. In this study we experimentally show that incorporating weak anomaly labels to standard segmentation models consistently improves lesion segmentation results. This can be done relatively easy by detecting anomalies with a separate model and then adding these output masks as an extra class for training the segmentation model. This provides additional semantic context without requiring extra manual labels. We empirically validated this strategy using two in-house and two publicly available retinal OCT datasets for multiple lesion targets, demonstrating the potential of this generic anomaly guided segmentation approach to be used as an extra tool for improving lesion detection models. Philipp Seeböck, José Ignacio Orlando, Martin Michl, Julia Mai, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
Medical Image Anal. | 6 |
| 2024 | Deep Multimodal Fusion of Data With Heterogeneous Dimensionality via Projective NetworksabstractThe use of multimodal imaging has led to significant improvements in the diagnosis and treatment of many diseases. Similar to clinical practice, some works have demonstrated the benefits of multimodal fusion for automatic segmentation and classification using deep learning-based methods. However, current segmentation methods are limited to fusion of modalities with the same dimensionality (e.g., 3D + 3D, 2D + 2D), which is not always possible, and the fusion strategies implemented by classification methods are incompatible with localization tasks. In this work, we propose a novel deep learning-based framework for the fusion of multimodal data with heterogeneous dimensionality (e.g., 3D + 2D) that is compatible with localization tasks. The proposed framework extracts the features of the different modalities and projects them into the common feature subspace. The projected features are then fused and further processed to obtain the final prediction. The framework was validated on the following tasks: segmentation of geographic atrophy (GA), a late-stage manifestation of age-related macular degeneration, and segmentation of retinal blood vessels (RBV) in multimodal retinal imaging. Our results show that the proposed method outperforms the state-of-the-art monomodal methods on GA and RBV segmentation by up to 3.10% and 4.64% Dice, respectively. José Morano, Guilherme Aresta, Christoph Grechenig, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
IEEE J. Biomed. Health Informatics | 5 |
| 2024 | Morph-SSL: Self-Supervision With Longitudinal Morphing for Forecasting AMD Progression From OCT VolumesabstractThe lack of reliable biomarkers makes predicting the conversion from intermediate to neovascular age-related macular degeneration (iAMD, nAMD) a challenging task. We develop a Deep Learning (DL) model to predict the future risk of conversion of an eye from iAMD to nAMD from its current OCT scan. Although eye clinics generate vast amounts of longitudinal OCT scans to monitor AMD progression, only a small subset can be manually labeled for supervised DL. To address this issue, we propose Morph-SSL, a novel Self-supervised Learning (SSL) method for longitudinal data. It uses pairs of unlabelled OCT scans from different visits and involves morphing the scan from the previous visit to the next. The Decoder predicts the transformation for morphing and ensures a smooth feature manifold that can generate intermediate scans between visits through linear interpolation. Next, the Morph-SSL trained features are input to a Classifier which is trained in a supervised manner to model the cumulative probability distribution of the time to conversion with a sigmoidal function. Morph-SSL was trained on unlabelled scans of 399 eyes (3570 visits). The Classifier was evaluated with a five-fold cross-validation on 2418 scans from 343 eyes with clinical labels of the conversion date. The Morph-SSL features achieved an AUC of 0.779 in predicting the conversion to nAMD within the next 6 months, outperforming the same network when trained end-to-end from scratch or pre-trained with popular SSL methods. Automated prediction of the future risk of nAMD onset can enable timely treatment and individualized AMD management. Arunava Chakravarty, Taha Emre, Oliver Leingang, Sophie Riedl 0001, Julia Mai, Hendrik P. N. Scholl, Sobha Sivaprasad, Daniel Rueckert, Andrew J. Lotery, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
IEEE Trans. Medical Imaging | 11 |
| 2024 | 3DTINC: Time-Equivariant Non-Contrastive Learning for Predicting Disease Progression From Longitudinal OCTsabstractSelf-supervised learning (SSL) has emerged as a powerful technique for improving the efficiency and effectiveness of deep learning models. Contrastive methods are a prominent family of SSL that extract similar representations of two augmented views of an image while pushing away others in the representation space as negatives. However, the state-of-the-art contrastive methods require large batch sizes and augmentations designed for natural images that are impractical for 3D medical images. To address these limitations, we propose a new longitudinal SSL method, 3DTINC, based on non-contrastive learning. It is designed to learn perturbation-invariant features for 3D optical coherence tomography (OCT) volumes, using augmentations specifically designed for OCT. We introduce a new non-contrastive similarity loss term that learns temporal information implicitly from intra-patient scans acquired at different times. Our experiments show that this temporal information is crucial for predicting progression of retinal diseases, such as age-related macular degeneration (AMD). After pretraining with 3DTINC, we evaluated the learned representations and the prognostic models on two large-scale longitudinal datasets of retinal OCTs where we predict the conversion to wet-AMD within a six-month interval. Our results demonstrate that each component of our contributions is crucial for learning meaningful representations useful in predicting disease progression from longitudinal volumetric scans. Taha Emre, Arunava Chakravarty, Antoine Rivail, Dmitry A. Lachinov, Oliver Leingang, Sophie Riedl 0001, Julia Mai, Hendrik P. N. Scholl, Sobha Sivaprasad, Daniel Rueckert, Andrew J. Lotery, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
IEEE Trans. Medical Imaging | 13 |
| 2024 | Learning Spatio-Temporal Model of Disease Progression With NeuralODEs From Longitudinal Volumetric DataabstractRobust forecasting of the future anatomical changes inflicted by an ongoing disease is an extremely challenging task that is out of grasp even for experienced healthcare professionals. Such a capability, however, is of great importance since it can improve patient management by providing information on the speed of disease progression already at the admission stage, or it can enrich the clinical trials with fast progressors and avoid the need for control arms by the means of digital twins. In this work, we develop a deep learning method that models the evolution of age-related disease by processing a single medical scan and providing a segmentation of the target anatomy at a requested future point in time. Our method represents a time-invariant physical process and solves a large-scale problem of modeling temporal pixel-level changes utilizing NeuralODEs. In addition, we demonstrate the approaches to incorporate the prior domain-specific constraints into our method and define temporal Dice loss for learning temporal objectives. To evaluate the applicability of our approach across different age-related diseases and imaging modalities, we developed and tested the proposed method on the datasets with 967 retinal OCT volumes of 100 patients with Geographic Atrophy and 2823 brain MRI volumes of 633 patients with Alzheimer's Disease. For Geographic Atrophy, the proposed method outperformed the related baseline models in the atrophy growth prediction. For Alzheimer's Disease, the proposed method demonstrated remarkable performance in predicting the brain ventricle changes induced by the disease, achieving the state-of-the-art result on TADPOLE cross-sectional prediction challenge dataset. Dmitry A. Lachinov, Arunava Chakravarty, Christoph Grechenig, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
IEEE Trans. Medical Imaging | 5 |
| 2024 | AIROGS: Artificial Intelligence for Robust Glaucoma Screening ChallengeabstractThe early detection of glaucoma is essential in preventing visual impairment. Artificial intelligence (AI) can be used to analyze color fundus photographs (CFPs) in a cost-effective manner, making glaucoma screening more accessible. While AI models for glaucoma screening from CFPs have shown promising results in laboratory settings, their performance decreases significantly in real-world scenarios due to the presence of out-of-distribution and low-quality images. To address this issue, we propose the Artificial Intelligence for Robust Glaucoma Screening (AIROGS) challenge. This challenge includes a large dataset of around 113,000 images from about 60,000 patients and 500 different screening centers, and encourages the development of algorithms that are robust to ungradable and unexpected input data. We evaluated solutions from 14 teams in this paper and found that the best teams performed similarly to a set of 20 expert ophthalmologists and optometrists. The highest-scoring team achieved an area under the receiver operating characteristic curve of 0.99 (95% CI: 0.98-0.99) for detecting ungradable images on-the-fly. Additionally, many of the algorithms showed robust performance when tested on three other publicly available datasets. These results demonstrate the feasibility of robust AI-enabled glaucoma screening. Coen de Vente, Koen A. Vermeer, Nicolas Jaccard, He Wang 0016, Hongyi Sun, Firas Khader, Daniel Truhn, Temirgali Aimyshev, Yerkebulan Zhanibekuly, Tien-Dung Le, Adrian Galdran, Miguel Ángel González Ballester, Gustavo Carneiro 0001, Devika R. G., Hrishikesh Panikkasseril Sethumadhavan, Densen Puthussery, Hong Liu 0007, Zekang Yang, Satoshi Kondo, Satoshi Kasai, Ashritha Durvasula, Jónathan Heras, Miguel Ángel Zapata, Teresa Araujo, Guilherme Aresta, Hrvoje Bogunovic, Mustafa Arikan, Yeong Chan Lee, Hyun Bin Cho, Yoon Ho Choi, Abdul Qayyum 0002, Muhammad Imran Razzak, Bram van Ginneken, Hans G. Lemij, Clara I. Sánchez |
IEEE Trans. Medical Imaging | 27 |
| 2023 | Clustering Disease Trajectories in Contrastive Feature Space for Biomarker Proposal in Age-Related Macular Degeneration
Robbie Holland, Oliver Leingang, Christopher Holmes, Philipp Anders, Rebecca Kaye, Sophie Riedl 0001, Johannes C. Paetzold, Ivan Ezhov, Hrvoje Bogunovic, Ursula Schmidt-Erfurth, Hendrik P. N. Scholl, Sobha Sivaprasad, Andrew J. Lotery, Daniel Rueckert, Martin J. Menten |
MICCAI (7) | 9 |
| 2023 | Self-supervised Learning via Inter-modal Reconstruction and Feature Projection Networks for Label-Efficient 3D-to-2D Segmentation
José Morano, Guilherme Aresta, Dmitry A. Lachinov, Julia Mai, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (4) | 6 |
| 2023 | Transformer-Based End-to-End Classification of Variable-Length Volumetric Data
Marzieh Oghbaie, Teresa Araujo, Taha Emre, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (6) | 5 |
| 2023 | GAMMA challenge: Glaucoma grAding from Multi-Modality imAges
Huihui Fang, Fei Li 0021, Huazhu Fu, Fengbin Lin, Jiongcheng Li, Yue Huang 0001, Qinji Yu, Sifan Song, Xinxing Xu, Yanyu Xu 0001, Wensai Wang, Shuai Lu 0003, Huiqi Li, Shihua Huang, Zhichao Lu, Chubin Ou, Xifei Wei, Bingyuan Liu, Riadh Kobbi, Xiaoying Tang 0001, Li Lin 0006, Hrvoje Bogunovic, José Ignacio Orlando, Xiulan Zhang, Yanwu Xu 0001 |
Medical Image Anal. | 26 |
| 2023 | Segmentation of Bruch's Membrane in Retinal OCT With AMD Using Anatomical Priors and Uncertainty QuantificationabstractBruch's membrane (BM) segmentation on optical coherence tomography (OCT) is a pivotal step for the diagnosis and follow-up of age-related macular degeneration (AMD), one of the leading causes of blindness in the developed world. Automated BM segmentation methods exist, but they usually do not account for the anatomical coherence of the results, neither provide feedback on the confidence of the prediction. These factors limit the applicability of these systems in real-world scenarios. With this in mind, we propose an end-to-end deep learning method for automated BM segmentation in AMD patients. An Attention U-Net is trained to output a probability density function of the BM position, while taking into account the natural curvature of the surface. Besides the surface position, the method also estimates an A-scan wise uncertainty measure of the segmentation output. Subsequently, the A-scans with high uncertainty are interpolated using thin plate splines (TPS). We tested our method with ablation studies on an internal dataset with 138 patients covering all three AMD stages, and achieved a mean absolute localization error of 4.10 μm. In addition, the proposed segmentation method was compared against the state-of-the-art methods and showed a superior performance on an external publicly available dataset from a different patient cohort and OCT device, demonstrating strong generalization ability. Botond Fazekas, Dmitry A. Lachinov, Guilherme Aresta, Julia Mai, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
IEEE J. Biomed. Health Informatics | 6 |
| 2022 | TINC: Temporally Informed Non-contrastive Learning for Disease Progression Modeling in Retinal OCT Volumes
Taha Emre, Arunava Chakravarty, Antoine Rivail, Sophie Riedl 0001, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (2) | 6 |
| 2022 | SD-LayerNet: Semi-supervised Retinal Layer Segmentation in OCT Using Disentangled Representation with Anatomical Priors
Botond Fazekas, Guilherme Aresta, Dmitry A. Lachinov, Sophie Riedl 0001, Julia Mai, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (8) | 7 |
| 2022 | Robust Fovea Detection in Retinal OCT Imaging Using Deep LearningabstractThe fovea centralis is an essential landmark in the retina where the photoreceptor layer is entirely composed of cones responsible for sharp, central vision. The localization of this anatomical landmark in optical coherence tomography (OCT) volumes is important for assessing visual function correlates and treatment guidance in macular disease. In this study, the "PRE U-net" is introduced as a novel approach for a fully automated fovea centralis detection, addressing the localization as a pixel-wise regression task. 2D B-scans are sampled from each image volume and are concatenated with spatial location information to train the deep network. A total of 5586 OCT volumes from 1,541 eyes were used to train, validate and test the deep learning method. The test data is comprised of healthy subjects and patients affected by neovascular age-related macular degeneration (nAMD), diabetic macula edema (DME) and macular edema from retinal vein occlusion (RVO), covering the three major retinal diseases responsible for blindness. Our experiments demonstrate that the PRE U-net significantly outperforms state-of-the-art methods and improves the robustness of automated localization, which is of value for clinical practice. Simon Schürer-Waldheim, Philipp Seeböck, Hrvoje Bogunovic, Bianca S. Gerendas, Ursula Schmidt-Erfurth |
IEEE J. Biomed. Health Informatics | 3 |
| 2022 | ADAM Challenge: Detecting Age-Related Macular Degeneration From Fundus ImagesabstractAge-related macular degeneration (AMD) is the leading cause of visual impairment among elderly in the world. Early detection of AMD is of great importance, as the vision loss caused by this disease is irreversible and permanent. Color fundus photography is the most cost-effective imaging modality to screen for retinal disorders. Cutting edge deep learning based algorithms have been recently developed for automatically detecting AMD from fundus images. However, there are still lack of a comprehensive annotated dataset and standard evaluation benchmarks. To deal with this issue, we set up the Automatic Detection challenge on Age-related Macular degeneration (ADAM), which was held as a satellite event of the ISBI 2020 conference. The ADAM challenge consisted of four tasks which cover the main aspects of detecting and characterizing AMD from fundus images, including detection of AMD, detection and segmentation of optic disc, localization of fovea, and detection and segmentation of lesions. As part of the ADAM challenge, we have released a comprehensive dataset of 1200 fundus images with AMD diagnostic labels, pixel-wise segmentation masks for both optic disc and AMD-related lesions (drusen, exudates, hemorrhages and scars, among others), as well as the coordinates corresponding to the location of the macular fovea. A uniform evaluation framework has been built to make a fair comparison of different models using this dataset. During the ADAM challenge, 610 results were submitted for online evaluation, with 11 teams finally participating in the onsite challenge. This paper introduces the challenge, the dataset and the evaluation methods, as well as summarizes the participating methods and analyzes their results for each task. In particular, we observed that the ensembling strategy and the incorporation of clinical domain knowledge were the key to improve the performance of the deep learning models. Huihui Fang, Fei Li 0021, Huazhu Fu, Xu Sun 0006, Xingxing Cao, Fengbin Lin, Jaemin Son, Gwenolé Quellec, Sarah Matta, Sharath M. Shankaranarayana, Chuen-heng Wang, Nisarg A. Shah, Chia-Yen Lee, Chih-Chung Hsu, Hai Xie, Bai Ying Lei, Ujjwal Baid, Shubham Innani, Kang Dang, Wenxiu Shi, Ravi Kamble, Nitin Singhal, Ching-Wei Wang, Shih-Chang Lo, José Ignacio Orlando, Hrvoje Bogunovic, Xiulan Zhang, Yanwu Xu 0001 |
IEEE Trans. Medical Imaging | 28 |
| 2021 | Projective Skip-Connections for Segmentation Along a Subset of Dimensions in Retinal OCT
Dmitry A. Lachinov, Philipp Seeböck, Julia Mai, Felix Goldbach, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (1) | 6 |
| 2020 | REFUGE Challenge: A unified framework for evaluating automated methods for glaucoma assessment from fundus photographsabstractGlaucoma is one of the leading causes of irreversible but preventable blindness in working age populations. Color fundus photography (CFP) is the most cost-effective imaging modality to screen for retinal disorders. However, its application to glaucoma has been limited to the computation of a few related biomarkers such as the vertical cup-to-disc ratio. Deep learning approaches, although widely applied for medical image analysis, have not been extensively used for glaucoma assessment due to the limited size of the available data sets. Furthermore, the lack of a standardize benchmark strategy makes difficult to compare existing methods in a uniform way. In order to overcome these issues we set up the Retinal Fundus Glaucoma Challenge, REFUGE (https://refuge.grand-challenge.org), held in conjunction with MICCAI 2018. The challenge consisted of two primary tasks, namely optic disc/cup segmentation and glaucoma classification. As part of REFUGE, we have publicly released a data set of 1200 fundus images with ground truth segmentations and clinical glaucoma labels, currently the largest existing one. We have also built an evaluation framework to ease and ensure fairness in the comparison of different models, encouraging the development of novel techniques in the field. 12 teams qualified and participated in the online challenge. This paper summarizes their methods and analyzes their corresponding results. In particular, we observed that two of the top-ranked teams outperformed two human experts in the glaucoma classification task. Furthermore, the segmentation results were in general consistent with the ground truth annotations, with complementary outcomes that can be further exploited by ensembling the results. José Ignacio Orlando, Huazhu Fu, João Barbosa Breda, Karel van Keer, Deepti R. Bathula, Andres Diaz-Pinto, Ruogu Fang, Pheng-Ann Heng, Jeyoung Kim, Joonseok Lee, Peng Liu 0049, Shuai Lu 0003, Balamurali Murugesan, Valery Naranjo, Sai Samarth R. Phaye, Sharath M. Shankaranarayana, Hrvoje Bogunovic |
Medical Image Anal. | 19 |
| 2020 | End-to-End Deep Learning Model for Predicting Treatment Requirements in Neovascular AMD From Longitudinal Retinal OCT ImagingabstractNeovascular age-related macular degeneration (nAMD) is nowadays successfully treated with anti-VEGF substances, but inter-individual treatment requirements are vastly heterogeneous and currently poorly plannable resulting in suboptimal treatment frequency. Optical coherence tomography (OCT) with its 3D high-resolution imaging serves as a companion diagnostic to anti-VEGF therapy. This creates a need for building predictive models using automated image analysis of OCT scans acquired during the treatment initiation phase. We propose such a model based on deep learning (DL) architecture, comprised of a densely connected neural network (DenseNet) and a recurrent neural network (RNN), trainable end-to-end. The method starts by sampling several 2D-images from an OCT volume to obtain a lower-dimensional OCT representation. At the core of the predictive model, the DenseNet learns useful retinal spatial features while the RNN integrates information from different time points. The introduced model was evaluated on the prediction of anti-VEGF treatment requirements in nAMD patients treated under a pro-re-nata (PRN) regimen. The DL model was trained on 281 patients and evaluated on a hold-out test set of 69 patient. The predictive model achieved a concordance index of 0.7 in regressing the number of received treatments, while in a classification task it obtained an 0.85 (0.81) AUC in detecting the patients with low (high) treatment requirements. The proposed model outperformed previous machine learning strategies that relied on a set of spatio-temporal image features, showing that the proposed DL architecture successfully learned to extract the relevant spatio-temporal patterns directly from raw longitudinal OCT images. David Romo-Bucheli, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
IEEE J. Biomed. Health Informatics | 3 |
| 2020 | Exploiting Epistemic Uncertainty of Anatomy Segmentation for Anomaly Detection in Retinal OCTabstractDiagnosis and treatment guidance are aided by detecting relevant biomarkers in medical images. Although supervised deep learning can perform accurate segmentation of pathological areas, it is limited by requiring a priori definitions of these regions, large-scale annotations, and a representative patient cohort in the training set. In contrast, anomaly detection is not limited to specific definitions of pathologies and allows for training on healthy samples without annotation. Anomalous regions can then serve as candidates for biomarker discovery. Knowledge about normal anatomical structure brings implicit information for detecting anomalies. We propose to take advantage of this property using Bayesian deep learning, based on the assumption that epistemic uncertainties will correlate with anatomical deviations from a normal training set. A Bayesian U-Net is trained on a well-defined healthy environment using weak labels of healthy anatomy produced by existing methods. At test time, we capture epistemic uncertainty estimates of our model using Monte Carlo dropout. A novel post-processing technique is then applied to exploit these estimates and transfer their layered appearance to smooth blob-shaped segmentations of the anomalies. We experimentally validated this approach in retinal optical coherence tomography (OCT) images, using weak labels of retinal layers. Our method achieved a Dice index of 0.789 in an independent anomaly test set of age-related macular degeneration (AMD) cases. The resulting segmentations allowed very high accuracy for separating healthy and diseased cases with late wet AMD, dry geographic atrophy (GA), diabetic macular edema (DME) and retinal vein occlusion (RVO). Finally, we qualitatively observed that our approach can also detect other deviations in normal scans such as cut edge artifacts. Philipp Seeböck, José Ignacio Orlando, Thomas Schlegl, Sebastian M. Waldstein, Hrvoje Bogunovic, Sophie Riedl 0001, Georg Langs, Ursula Schmidt-Erfurth |
IEEE Trans. Medical Imaging | 5 |
| 2020 | Correction to "Exploiting Epistemic Uncertainty of Anatomy Segmentation for Anomaly Detection in Retinal OCT"
Philipp Seeböck, José Ignacio Orlando, Thomas Schlegl, Sebastian M. Waldstein, Hrvoje Bogunovic, Sophie Riedl 0001, Georg Langs, Ursula Schmidt-Erfurth |
IEEE Trans. Medical Imaging | 5 |
| 2019 | Multiclass Segmentation as Multitask Learning for Drusen Segmentation in Retinal Optical Coherence Tomography
Rhona Asgari, José Ignacio Orlando, Sebastian M. Waldstein, Ferdinand Schlanitz, Magdalena Baratsits, Ursula Schmidt-Erfurth, Hrvoje Bogunovic |
MICCAI (1) | 7 |
| 2019 | RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and ChallengeabstractRetinal swelling due to the accumulation of fluid is associated with the most vision-threatening retinal diseases. Optical coherence tomography (OCT) is the current standard of care in assessing the presence and quantity of retinal fluid and image-guided treatment management. Deep learning methods have made their impact across medical imaging, and many retinal OCT analysis methods have been proposed. However, it is currently not clear how successful they are in interpreting the retinal fluid on OCT, which is due to the lack of standardized benchmarks. To address this, we organized a challenge RETOUCH in conjunction with MICCAI 2017, with eight teams participating. The challenge consisted of two tasks: fluid detection and fluid segmentation. It featured for the first time: all three retinal fluid types, with annotated images provided by two clinical centers, which were acquired with the three most common OCT device vendors from patients with two different retinal diseases. The analysis revealed that in the detection task, the performance on the automated fluid detection was within the inter-grader variability. However, in the segmentation task, fusing the automated methods produced segmentations that were superior to all individual methods, indicating the need for further improvements in the segmentation performance. Hrvoje Bogunovic, Freerk G. Venhuizen, Sophie Riedl 0001, Stefanos Apostolopoulos, Alireza Bab-Hadiashar, Ulas Bagci, Mirza Faisal Beg, Loza Bekalo, Qiang Chen 0004, Carlos Ciller, Karthik Gopinath, Amirali Khodadadian Gostar, Kiwan Jeon, Zexuan Ji, Sung Ho Kang, Dara Koozekanani, Donghuan Lu, Dustin Morley, Keshab K. Parhi, Hyoung Suk Park, Abdolreza Rashno, Marinko Sarunic, Saad Shaikh, Jayanthi Sivaswamy, Ruwan B. Tennakoon, Shivin Yadav, Sandro De Zanet, Sebastian M. Waldstein, Bianca S. Gerendas, Caroline C. W. Klaver, Clara I. Sánchez, Ursula Schmidt-Erfurth |
IEEE Trans. Medical Imaging | 1 |
| 2019 | Unsupervised Identification of Disease Marker Candidates in Retinal OCT Imaging DataabstractThe identification and quantification of markers in medical images is critical for diagnosis, prognosis, and disease management. Supervised machine learning enables the detection and exploitation of findings that are known a priori after annotation of training examples by experts. However, supervision does not scale well, due to the amount of necessary training examples, and the limitation of the marker vocabulary to known entities. In this proof-of-concept study, we propose unsupervised identification of anomalies as candidates for markers in retinal optical coherence tomography (OCT) imaging data without a constraint to a priori definitions. We identify and categorize marker candidates occurring frequently in the data and demonstrate that these markers show a predictive value in the task of detecting disease. A careful qualitative analysis of the identified data driven markers reveals how their quantifiable occurrence aligns with our current understanding of disease course, in early- and late age-related macular degeneration (AMD) patients. A multi-scale deep denoising autoencoder is trained on healthy images, and a one-class support vector machine identifies anomalies in new data. Clustering in the anomalies identifies stable categories. Using these markers to classify healthy-, early AMD- and late AMD cases yields an accuracy of 81.40%. In a second binary classification experiment on a publicly available data set (healthy versus intermediate AMD), the model achieves an area under the ROC curve of 0.944. Philipp Seeböck, Sebastian M. Waldstein, Sophie Riedl 0001, Hrvoje Bogunovic, Thomas Schlegl, Bianca S. Gerendas, Rene Donner, Ursula Schmidt-Erfurth, Georg Langs |
IEEE Trans. Medical Imaging | 4 |
| 2018 | How to Exploit Weaknesses in Biomedical Challenge Design and Organization
Annika Reinke, Matthias Eisenmann, Sinan Onogur, Marko Stankovic 0002, Patrick Godau, Peter M. Full, Hrvoje Bogunovic, Bennett A. Landman, Oskar Maier, Bjoern Menze, Gregory C. Sharp, Korsuk Sirinukunwattana, Stefanie Speidel, Fons van der Sommen, Guoyan Zheng, Henning Müller, Michal Kozubek 0001, Tal Arbel, Andrew P. Bradley, Pierre Jannin, Annette Kopp-Schneider, Lena Maier-Hein |
MICCAI (4) | 7 |
| 2014 | Multi-Surface and Multi-Field Co-Segmentation of 3-D Retinal Optical Coherence TomographyabstractWhen segmenting intraretinal layers from multiple optical coherence tomography (OCT) images forming a mosaic or a set of repeated scans, it is attractive to exploit the additional information from the overlapping areas rather than discarding it as redundant, especially in low contrast and noisy images. However, it is currently not clear how to effectively combine the multiple information sources available in the areas of overlap. In this paper, we propose a novel graph-theoretic method for multi-surface multi-field co-segmentation of intraretinal layers, assuring consistent segmentation of the fields across the overlapped areas. After 2-D en-face alignment, all the fields are segmented simultaneously, imposing a priori soft interfield-intrasurface constraints for each pair of overlapping fields. The constraints penalize deviations from the expected surface height differences, taken to be the depth-axis shifts that produce the maximum cross-correlation of pairwise-overlapped areas. The method's accuracy and reproducibility are evaluated qualitatively and quantitatively on 212 OCT images (20 nine-field, 32 single-field acquisitions) from 26 patients with glaucoma. Qualitatively, the obtained thickness maps show no stitching artifacts, compared to pronounced stitches when the fields are segmented independently. Quantitatively, two ophthalmologists manually traced four intraretinal layers on 10 patients, and the average error ( 4.58 ±1.46 μm) was comparable to the average difference between the observers ( 5.86±1.72 μm). Furthermore, we show the benefit of the proposed approach in co-segmenting longitudinal scans. As opposed to segmenting layers in each of the fields independently, the proposed co-segmentation method obtains consistent segmentations across the overlapped areas, producing accurate, reproducible, and artifact-free results. Hrvoje Bogunovic, Milan Sonka, Young H. Kwon, Pavlina Kemp, Michael D. Abràmoff, Xiaodong Wu 0001 |
IEEE Trans. Medical Imaging | 1 |
| 2013 | Anatomical Labeling of the Circle of Willis Using Maximum A Posteriori Probability EstimationabstractAnatomical labeling of the cerebral arteries forming the Circle of Willis (CoW) enables inter-subject comparison, which is required for geometric characterization and discovering risk factors associated with cerebrovascular pathologies. We present a method for automated anatomical labeling of the CoW by detecting its main bifurcations. The CoW is modeled as rooted attributed relational graph, with bifurcations as its vertices, whose attributes are characterized as points on a Riemannian manifold. The method is first trained on a set of pre-labeled examples, where it learns the variability of local bifurcation features as well as the variability in the topology. Then, the labeling of the target vasculature is obtained as maximum a posteriori probability (MAP) estimate where the likelihood of labeling individual bifurcations is regularized by the prior structural knowledge of the graph they span. The method was evaluated by cross-validation on 50 subjects, imaged with magnetic resonance angiography, and showed a mean detection accuracy of 95%. In addition, besides providing the MAP, the method can rank the labelings. The proposed method naturally handles anatomical structural variability and is demonstrated to be suitable for labeling arterial segments of the CoW. Hrvoje Bogunovic, José María Pozo, Rubén Cárdenes, Luis San-Román, Alejandro F. Frangi |
IEEE Trans. Medical Imaging | 1 |
| 2012 | Automated landmarking and geometric characterization of the carotid siphon
Hrvoje Bogunovic, José María Pozo, Rubén Cárdenes, Maria-Cruz Villa-Uriol, Raphaël Blanc, Michel Piotin, Alejandro F. Frangi |
Medical Image Anal. | 1 |
| 2011 | Anatomical Labeling of the Anterior Circulation of the Circle of Willis Using Maximum a Posteriori Classification
Hrvoje Bogunovic, José María Pozo, Rubén Cárdenes, Alejandro F. Frangi |
MICCAI (3) | 1 |
| 2011 | 3D Modeling of Coronary Artery Bifurcations from CTA and Conventional Coronary Angiography
Rubén Cárdenes, José-Luis Díez, Ignacio Larrabide, Hrvoje Bogunovic, Alejandro F. Frangi |
MICCAI (3) | 4 |
| 2011 | Automatic Aneurysm Neck Detection Using Surface Voronoi DiagramsabstractA new automatic approach for saccular intracranial aneurysm isolation is proposed in this work. Due to the inter- and intra-observer variability in manual delineation of the aneurysm neck, a definition based on a minimum cost path around the aneurysm sac is proposed that copes with this variability and is able to make consistent measurements along different data sets, as well as to automate and speedup the analysis of cerebral aneurysms. The method is based on the computation of a minimal path along a scalar field obtained on the vessel surface, to find the aneurysm neck in a robust and fast manner. The computation of the scalar field on the surface is obtained using a fast marching approach with a speed function based on the exponential of the distance from the centerline bifurcation between the aneurysm dome and the parent vessels. In order to assure a correct topology of the aneurysm sac, the neck computation is constrained to a region defined by a surface Voronoi diagram obtained from the branches of the vessel centerline. We validate this method comparing our results in 26 real cases with manual aneurysm isolation obtained using a cut-plane, and also with results obtained using manual delineations from three different observers by comparing typical morphological measures. Rubén Cárdenes, José María Pozo, Hrvoje Bogunovic, Ignacio Larrabide, Alejandro F. Frangi |
IEEE Trans. Medical Imaging | 3 |
| 2010 | Fast 3D centerline computation for tubular structures by front collapsing and fast marchingabstractIn this work, we propose a fast approach to compute centerlines from 3D tubular domains. This technique is based on the distance transform (DT) from the object boundaries, whose implementation together with an efficient technique to detect the points where the DT collapse, allow to obtain an initial centerline, very close to the final solution. This initial centerline and the DT computed, are used in a second step to obtain a connected, one voxel thick centerline, with a fast marching approach. The method proposed here is accurate, computationally efficient, fully automatic, is able to account for loops, and also obtains the bifurcation and end points automatically. Rubén Cárdenes, Hrvoje Bogunovic, Alejandro F. Frangi |
ICIP | 2 |
| 2009 | Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms
Michiel Schaap, Coert Metz, Theo van Walsum, Alina G. van der Giessen, Annick C. Weustink, Nico Mollet, Christian Bauer 0001, Hrvoje Bogunovic, Carlos Castro-Gonzalez, Engin Dikici, Thomas O'Donnell, Michel Frenay, Ola Friman, Marcela Hernández Hoyos, Pieter H. Kitslaar, Karl Krissian, Caroline Kühnel, Miguel A. Luengo-Oroz, Maciej Orkisz, Örjan Smedby, Martin Styner, Andrzej Szymczak, Hüseyin Tek, Chunliang Wang, Simon K. Warfield, Sebastian Zambal, Gabriel P. Krestin, Wiro J. Niessen |
Medical Image Anal. | 8 |
| 2006 | Blood Flow and Velocity Estimation Based on Vessel Transit Time by Combining 2D and 3D X-Ray Angiography
Hrvoje Bogunovic, Sven Loncaric |
MICCAI (2) | 1 |