Hugo J. Kuijf

dblp:44/9772 · also Hugo Jaco Kuijf · DBLP profile ↗
← Back
8ranked-venue papers
1as first author
6since 2021 · last 2025
0000-0001-6997-9059ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Applied, interdisciplinary, general and emerging computing · 7 · 1 first-author · 5 since 2021Graphics, computer vision, multimedia, augmented reality and games · 2 · 1 since 2021Artificial intelligence and machine learning · 1 · 1 since 2021
YearPublicationVenuePosition
2025 Evaluation of techniques for automated classification and artery quantification of the circle of Willis on TOF-MRA images: The CROWN challenge
abstract
Assessing risk factors for intracranial aneurysm (IA) development on images is crucial for early detection of high-risk cases. IAs often form at bifurcations within the circle of Willis (CoW), but manual assessment of these arteries is both time-consuming and susceptible to inconsistencies. Previous studies on imaging markers for IA development lack sufficient evidence for clinical implications, highlighting the need for automated methods to assess CoW morphology. No systematic approach currently exists to identify the best methodological strategies. To address this, we organized a scientific challenge to compare various techniques against a clinical reference standard. Participants were tasked with (1) automated classification of CoW anatomical variants and (2) automated prediction of CoW artery diameters and bifurcation angles. We provided 300 TOF-MRA scans for training and another 300 for testing, all manually annotated. Submissions were evaluated using balanced accuracy, mean absolute error, and Pearson correlation coefficient metrics. This paper provides a detailed analysis of the results from six participating teams. The findings show that various methods may be suitable for automated CoW assessment, but that these need further improvement to meet clinical standards. The challenge remains open for future submissions, offering a benchmark for new techniques.
Iris N. Vos, Ynte M. Ruigrok, Edwin Bennink, Mireille R. E. Velthuis, Barbara Paic, Maud E. H. Ophelders, Myrthe A. D. Buser, Bas H. M. van der Velden, Chen Geng 0002, Matthieu Coupet, Félix Dumais, Adrian Galdran, Wei Liu 0005, Madhu S. Nair, Mathieu Naudin, Preena K. P., Keerthi A. S. Pillai, Thierry Urruty, Yakang Dai, Kaiyuan Yang 0003, Fabio Musio, Bjoern Menze, Birgitta K. Velthuis, Hugo J. Kuijf
Medical Image Anal.27
2024 Where is VALDO? VAscular Lesions Detection and segmentatiOn challenge at MICCAI 2021
Carole H. Sudre, Kimberlin M. H. van Wijnen, Florian Dubost, Hieab Adams, David Atkinson, Frederik Barkhof, Mahlet A. Birhanu, Esther Bron, Robin Camarasa, Nish Chaturvedi, Qi Dou 0001, Tavia E. Evans, Ivan Ezhov, Haojun Gao, Marta Gironés-Sangüesa, Juan Domingo Gispert, Beatriz Gomez Anson, Alun D. Hughes, Mohammad Arfan Ikram, Silvia Ingala, Hans Rolf Jäger, Florian Kofler, Hugo J. Kuijf, Denis Kutnar, Bo Li 0088, Luigi Lorenzini, Bjoern Menze, José Luis Molinuevo, Yiwei Pan, Élodie Puybareau, Rafael Rehwald, Ruisheng Su, Lorna Smith, Therese Tillin, Guillaume Tochon, Hélène Urien, Bas H. M. van der Velden, Isabelle F. van der Velpen, Benedikt Wiestler, Frank J. Wolters, Pinar Yilmaz, Marius de Groot, Meike W. Vernooij, Marleen de Bruijne
Medical Image Anal.26
2023 Why is the Winner the Best?
abstract
International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multicenter study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on comprehensive descriptions of the submitted algorithms linked to their rank as well as the underlying participation strategies revealed common characteristics of winning solutions. These typically include the use of multi-task learning (63%) and/or multi-stage pipelines (61%), and a focus on augmentation (100%), image preprocessing (97%), data curation (79%), and post-processing (66%). The “typical” lead of a winning team is a computer scientist with a doctoral degree, five years of experience in biomedical image analysis, and four years of experience in deep learning. Two core general development strategies stood out for highly-ranked teams: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases. According to the organizers, 43% of the winning algorithms exceeded the state of the art but only 11% completely solved the respective domain problem. The insights of our study could help researchers (1) improve algorithm development strategies when approaching new problems, and (2) focus on open research questions revealed by this work.
Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Tizabi, Fabian Isensee, Tim Adler, Sharib Ali, Vincent Andrearczyk, Marc Aubreville, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano, Jorge Bernal, Sebastian Bodenstedt, Alessandro Casella, Veronika Cheplygina, Marie Daum, Marleen de Bruijne, Adrien Depeursinge, Reuben Dorent, Jan Egger, David Gage Ellis, Sandy Engelhardt, Melanie Ganz-Benjaminsen, Noha M. Ghatwary, Gabriel Girard, Patrick Godau, Anubha Gupta, Lasse Hansen, Kanako Harada, Mattias P. Heinrich, Nicholas Heller, Alessa Hering, Arnaud Huaulmé, Pierre Jannin, A. Emre Kavur, Oldrich Kodym, Michal Kozubek 0001, Jianning Li 0002, Hongwei Li 0004, Jun Ma 0016, Carlos Martín-Isla, Bjoern Menze, J. Alison Noble, Valentin Oreiller, Nicolas Padoy, Sarthak Pati, Kelly Payette, Tim Rädsch, Jonathan Rafael-Patino, Vivek Singh Bawa, Stefanie Speidel, Carole H. Sudre, Kimberlin M. H. van Wijnen, Martin Wagner 0001, D. Wei, Amine Yamlahi, Moi Hoon Yap, C. Yuan, Maximilian Zenk, A. Zia, David Zimmerer, Dogu Baran Aydogan, Binod Bhattarai, Louise Bloch, Raphael Brüngel, J. Cho, C. Choi, Qi Dou 0001, Ivan Ezhov, Christoph M. Friedrich, C. Fuller, Rebati Raman Gaire, Adrian Galdran, Álvaro García-Faura, Maria Grammatikopoulou, S. Hong, Mostafa Jahanifar, I. Jang, Abdolrahim Kadkhodamohammadi, I. Kang, Florian Kofler, S. Kondo, Hugo J. Kuijf, M. Luu, Tomaz Martincic, Pedro Morais, Mohamed A. Naser, Bruno Oliveira 0002, David Owen 0001, S. Pang, Szymon Plotka, Élodie Puybareau, Nasir M. Rajpoot, K. Ryu, Numan Saeed, Adam J. Shephard, Dejan Stepec, Ronast Subedi, Guillaume Tochon, Helena R. Torres, Hélène Urien, João L. Vilaça, Kareem A. Wahid, Benedikt Wiestler, Marek Wodzinski, F. Xia, J. Xie, Z. Xiong, Sen Yang 0006, Klaus H. Maier-Hein, Paul F. Jaeger, Annette Kopp-Schneider, Lena Maier-Hein
CVPR85
2023 Geometric Deep Learning Using Vascular Surface Meshes for Modality-Independent Unruptured Intracranial Aneurysm Detection
abstract
Early detection of unruptured intracranial aneurysms (UIAs) enables better rupture risk and preventative treatment assessment. UIAs are usually diagnosed on Time-of-Flight Magnetic Resonance Angiographs (TOF-MRA) or contrast-enhanced Computed Tomography Angiographs (CTA). Various automatic voxel-based deep learning UIA detection methods have been developed, but these are limited to a single modality. We propose a modality-independent UIA detection method using a geometric deep learning model with high resolution surface meshes of brain vessels. A mesh convolutional neural network with ResU-Net style architecture was used. UIA detection performance was investigated with different input and pooling mesh resolutions, and including additional edge input features (shape index and curvedness). Both a higher resolution mesh (15,000 edges) and additional curvature edge features improved performance (average sensitivity: 65.6%, false positive count/image (FPC/image): 1.61). UIAs were detected in an independent TOF-MRA test set and a CTA test set with average sensitivity of 52.0% and 48.3% and average FPC/image of 1.04 and 1.05 respectively. We provide modality-independent UIA detection using a deep-learning vascular surface mesh model with comparable performance to state-of-the-art UIA detection methods.
Kimberley M. Timmins, Irene C. van der Schaaf, Iris N. Vos, Ynte M. Ruigrok, Birgitta K. Velthuis, Hugo J. Kuijf
IEEE Trans. Medical Imaging6
2022 Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
abstract
With an increase in deep learning-based methods, the call for explainability of such methods grows, especially in high-stakes decision making areas such as medical image analysis. This survey presents an overview of explainable artificial intelligence (XAI) used in deep learning-based medical image analysis. A framework of XAI criteria is introduced to classify deep learning-based medical image analysis methods. Papers on XAI techniques in medical image analysis are then surveyed and categorized according to the framework and according to anatomical location. The paper concludes with an outlook of future opportunities for XAI in medical image analysis.
Bas H. M. van der Velden, Hugo J. Kuijf, Kenneth G. A. Gilhuijs, Max A. Viergever
Medical Image Anal.2
2021 Subvoxel vessel wall thickness measurements of the intracranial arteries using a convolutional neural network
abstract
Vessel wall thickening of the intracranial arteries has been associated with cerebrovascular disease and atherosclerotic plaque development. Visualization of the vessel wall has been enabled by recent advancements in vessel wall MRI. However, quantifying early wall thickening from these MR images is difficult and prone to severe overestimation, because the voxel size of clinically used acquisitions exceeds the wall thickness of the intracranial arteries. In this study, we aimed for accurate and precise subvoxel vessel wall thickness measurements. A convolutional neural network was trained on MR images of 34 ex vivo circle of Willis specimens, acquired with a clinically used protocol (isotropic acquired voxel size: 0.8 mm). Ground truth measurements were performed on images acquired with an ultra-high-resolution protocol (isotropic acquired voxel size: 0.11 mm) and were used for evaluation. Additionally, we determined the robustness of our method by applying Monte Carlo dropout and test time augmentation. Lastly, we applied our method on in vivo images of three intracranial aneurysms to measure their wall thickness. Our method shows resolvability of different vessel wall thicknesses, well below the acquired voxel size. The method described may facilitate quantitative measurements on MRI data for a wider range of clinical applications.
Kees M. van Hespen, Jaco J. M. Zwanenburg, Jeroen Hendrikse, Hugo J. Kuijf
Medical Image Anal.4
2019 Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challenge
abstract
Quantification of cerebral white matter hyperintensities (WMH) of presumed vascular origin is of key importance in many neurological research studies. Currently, measurements are often still obtained from manual segmentations on brain MR images, which is a laborious procedure. The automatic WMH segmentation methods exist, but a standardized comparison of the performance of such methods is lacking. We organized a scientific challenge, in which developers could evaluate their methods on a standardized multi-center/-scanner image dataset, giving an objective comparison: the WMH Segmentation Challenge. Sixty T1 + FLAIR images from three MR scanners were released with the manual WMH segmentations for training. A test set of 110 images from five MR scanners was used for evaluation. The segmentation methods had to be containerized and submitted to the challenge organizers. Five evaluation metrics were used to rank the methods: 1) Dice similarity coefficient; 2) modified Hausdorff distance (95th percentile); 3) absolute log-transformed volume difference; 4) sensitivity for detecting individual lesions; and 5) F1-score for individual lesions. In addition, the methods were ranked on their inter-scanner robustness; 20 participants submitted their methods for evaluation. This paper provides a detailed analysis of the results. In brief, there is a cluster of four methods that rank significantly better than the other methods, with one clear winner. The inter-scanner robustness ranking shows that not all the methods generalize to unseen scanners. The challenge remains open for future submissions and provides a public platform for method evaluation.
Hugo J. Kuijf, Adrià Casamitjana, D. Louis Collins, Mahsa Dadar, Achilleas Georgiou, Mohsen Ghafoorian, Dakai Jin, April Khademi, Jesse Knight, Hongwei Li 0004, Xavier Lladó, J. Matthijs Biesbroek, Miguel Luna, Qaiser Mahmood, Richard McKinley, Alireza Mehrtash, Sébastien Ourselin, Bo-yong Park, Hyunjin Park, Simon Pezold, Élodie Puybareau, Jeroen de Bresser, Letícia Rittner, Carole H. Sudre, Sergi Valverde, Verónica Vilaplana, Roland Wiest, Yongchao Xu, Ziyue Xu 0004, Guodong Zeng, Jianguo Zhang 0001, Guoyan Zheng, Rutger Heinen, Christopher Li Hsian Chen, Wiesje M. van der Flier, Frederik Barkhof, Max A. Viergever, Geert Jan Biessels, Simon Andermatt, Mariana P. Bento, Matt Berseth, Mikhail Belyaev, Manuel Jorge Cardoso
IEEE Trans. Medical Imaging1
2016 Employing Visual Analytics to Aid the Design of White Matter Hyperintensity Classifiers
Renata G. Raidou, Hugo J. Kuijf, Neda Sepasian, Nicola Pezzotti, Willem H. Bouvy, Marcel Breeuwer, Anna Vilanova
MICCAI (2)2