Large-scale datasets are essential for training deep learning models in medical imaging. However, many of these datasets contain poor-quality images that can compromise model performance and clinical reliability. In this study, we propose a framework to detect non-compliant images, such as corrupted scans, incomplete thorax X-rays, and images of non-thoracic body parts, by leveraging contrastive learning for feature extraction and parametric or non-parametric scoring methods for out-of-distribution ranking. Our approach was developed and tested on the CheXpert dataset, achieving an AUC of 0.75 in a manually labeled subset of 1,000 images, and further qualitatively and visually validated on the external PadChest dataset, where it also performed effectively. Our results demonstrate the potential of contrastive learning to detect non-compliant images in large-scale medical datasets, laying the foundation for future work on reducing dataset pollution and improving the robustness of deep learning models in clinical practice.

Machine Learning models need large amounts of annotated data for training. In the field of medical imaging, labeled data is especially difficult to obtain because the annotations have to be performed by qualified physicians. Natural Language Processing (NLP) tools can be applied to radiology reports to extract labels for medical images automatically. Compared to manual labeling, this approach requires smaller annotation efforts and can therefore facilitate the creation of labeled medical image data sets. In this article, we summarize the literature on this topic spanning from 2013 to 2023, starting with a meta-analysis of the included articles, followed by a qualitative and quantitative systematization of the results. Overall, we found four types of studies on the extraction of labels from radiology reports: those describing systems based on symbolic NLP, statistical NLP, neural NLP, and those describing systems combining or comparing two or more of the latter. Despite the large variety of existing approaches, there is still room for further improvement. This work can contribute to the development of new techniques or the improvement of existing ones.

The integration of explanation techniques promotes the comprehension of a model’s output and contributes to its interpretation e.g. by generating heat maps highlighting the most decisive regions for that prediction. However, there are several drawbacks to the current heat map-generating methods. Probability by itself is not indicative of the model’s conviction in a prediction, as it is influenced by multiple factors, such as class imbalance. Consequently, it is possible that a model yields two true positive predictions - one with an accurate explanation map, and the other with an inaccurate one. Current state-of-the-art explanations are not able to distinguish both scenarios and alert the user to dubious explanations. The goal of this work is to represent these maps more intuitively based on how confident the model is regarding the diagnosis, by adding an extra validation step over the state-of-the-art results that indicates whether the user should trust the initial explanation or not. The proposed method, Confident-CAM, facilitates the interpretation of the results by measuring the distance between the output probability and the corresponding class threshold, using a confidence score to generate nearly null maps when the initial explanations are most likely incorrect. This study implements and validates the proposed algorithm on a multi-label chest X-ray classification exercise, targeting 14 radiological findings in the ChestX-Ray14 dataset with significant class imbalance. Results indicate that confidence scores can distinguish likely accurate and inaccurate explanations. Code available via GitHub.

The importance of X-Ray imaging analysis is paramount for health care institutions since it is the main imaging modality for patient diagnosis, and deep learning can be used to aid clinicians in image diagnosis or structure segmentation. In recent years, several articles demonstrate the capability that deep learning models have in classifying and segmenting chest x-ray images if trained in an annotated dataset. Unfortunately, for segmentation tasks, only a few relatively small datasets have annotations, which poses a problem for the training of robust deep learning strategies. In this work, a semi-supervised approach is developed which consists of using available information regarding other anatomical structures to guide the segmentation when the groundtruth segmentation for a given structure is not available. This semi-supervised is compared with a fully- supervised approach for the tasks of lung segmentation and for multi-structure segmentation (lungs, heart and clavicles) in chest x-ray images. The semi-supervised lung predictions are evaluated visually and show relevant improvements, therefore this approach could be used to improve performance in external datasets with missing groundtruth. The multi-structure predictions show an improvement in mean absolute and Hausdorff distances when compared to a fully supervised approach and visual analysis of the segmentations shows that false positive predictions are removed. In conclusion, the developed method results in a new strategy that can help solve the problem of missing annotations and increase the quality of predictions in new datasets.

The development of accurate methods for OCT image analysis is highly dependent on the availability of large annotated datasets. As such datasets are usually expensive and hard to obtain, novel approaches based on deep generative models have been proposed for data augmentation. In this work, a flow-based network (SRFlow) and a generative adversarial network (ESRGAN) are used for synthesizing high-resolution OCT B-scans from low-resolution versions of real OCT images. The quality of the images generated by the two models is assessed using two standard fidelity-oriented metrics and a learned perceptual quality metric. The performance of two classification models trained on real and synthetic images is also evaluated. The obtained results show that the images generated by SRFlow preserve higher fidelity to the ground truth, while the outputs of ESRGAN present, on average, better perceptual quality. Independently of the architecture of the network chosen to classify the OCT B-scans, the model's performance always improves when images generated by SRFlow are included in the training set.

Chest radiography is one of the most ubiquitous medical imaging modalities. Nevertheless, the interpretation of chest radiography images is time-consuming, complex and subject to observer variability. As such, automated diagnosis systems for pathology detection have been proposed, aiming to reduce the burden on radiologists. The advent of deep learning has fostered the development of solutions for both abnormality detection with promising results. However, these tools suffer from poor explainability as the reasons that led to a decision cannot be easily understood, representing a major hurdle for their adoption in clinical practice. In order to overcome this issue, a method for chest radiography abnormality detection is presented which relies on an object detection framework to detect individual findings and thus separate normal and abnormal CXRs. It is shown that this framework is capable of an excellent performance in abnormality detection (AUC: 0.993), outperforming other state- of-the-art classification methodologies (AUC: 0.976 using the same classes). Furthermore, validation on external datasets shows that the proposed framework has a smaller drop in performance when applied to previously unseen data (21.9 % vs 23.4 % on average). Several approaches for object detection are compared and it is shown that merging pathology classes to minimize radiologist variability improves the localization of abnormal regions (0.529 vs 0.491 APF when using all pathology classes), resulting in a network which is more explainable and thus more suitable for integration in clinical practice.

Backed by more powerful computational resources and optimized training routines, deep learning models have attained unprecedented performance in extracting information from chest X-ray data. Preceding other tasks, an automated abnormality detection stage can be useful to prioritize certain exams and enable a more efficient clinical workflow. However, the presence of image artifacts such as lettering often generates a harmful bias in the classifier, leading to an increase of false positive results. Consequently, health care would benefit from a system that selects the thoracic region of interest prior to deciding whether an image is possibly pathologic. The current work tack-les this binary classification exercise using an attention-driven and spatially unsupervised Spatial Transformer Network (STN). The results indicate that the STN achieves similar results to using YOLO-cropped images, with fewer computational expenses and without the need for localization labels. More specifically, the system is able to distinguish between normal and abnormal CheXpert Images with a mean AUC of 84.22%.

Deep Learning (DL) algorithms allow fast results with high accuracy in medical imaging analysis solutions. However, to achieve a desirable performance, they require large amounts of high quality data. Active Learning (AL) is a subfield of DL that aims for more efficient models requiring ideally fewer data, by selecting the most relevant information for training. CheXpert is a Chest X-Ray (CXR) dataset, containing labels for different pathologic findings, alongside a “Support Devices” (SD) label. The latter contains several misannotations, which may impact the performance of a pathology detection model. The aim of this work is the detection of SDs in CheXpert CXR images and the comparison of the resulting predictions with the original CheXpert SD annotations, using AL approaches. A subset of 10,220 images was selected, manually annotated for SDs and used in the experimentations. In the first experiment, an initial model was trained on the seed dataset (6,200 images from this subset). The second and third approaches consisted in AL random sampling and least confidence techniques. In both of these, the seed dataset was used initially, and more images were iteratively employed. Finally, in the fourth experiment, a model was trained on the full annotated set. The AL least confidence experiment outperformed the remaining approaches, presenting an AUC of 71.10% and showing that training a model with representative information is favorable over training with all labeled data. This model was used to obtain predictions, which can be useful to limit the use of SD mislabelled images in future models.

Chest radiography is one of the most ubiquitous imaging modalities, playing an essential role in screening, diagnosis and disease management. However, chest radiography interpretation is a time-consuming and complex task, requiring the availability of experienced radiologists. As such, automated diagnosis systems for pathology detection have been proposed aiming to reduce the burden on radiologists and reduce variability in image interpretation. While promising results have been obtained, particularly since the advent of deep learning, there are significant limitations in the developed solutions, namely the lack of representative data for less frequent pathologies and the learning of biases from the training data, such as patient position, medical devices and other markers as proxies for certain pathologies. The lack of explainability is also a challenge for the adoption of these solutions in clinical practice.Generative adversarial networks could play a significant role as a solution for these challenges as they allow to artificially create new realistic images. This way, new synthetic chest radiography images could be used to increase the prevalence of less represented pathology classes and decrease model biases as well as improving the explainability of automatic decisions by generating samples that serve as examples or counter-examples to the image being analysed, ensuring patient privacy.In this study, a few-shot generative adversarial network is used to generate synthetic chest radiography images. A minimum Fréchet Inception Distance score of 17.83 was obtained, allowing to generate convincing synthetic images. Perceptual validation was then performed by asking multiple readers to classify a mixed set of synthetic and real images. An average accuracy of 83.5% was obtained but a strong dependency on reader experience level was observed. While synthetic images showed structural irregularities, the overall image sharpness was a major factor in the decision of readers. The synthetic images were then validated using a MobileNet abnormality classifier and it was shown that over 99% of images were classified correctly, indicating that the generated images were correctly interpreted by the classifier. Finally, the use of the synthetic images during training of a YOLOv5 pathology detector showed that the addition of the synthetic images led to an improvement of mean average precision of 0.05 across 14 pathologies.In conclusion, the usage of few-shot generative adversarial networks for chest radiography image generation was shown and tested in multiple scenarios, establishing a baseline for future experiments to increase the applicability of generative models in clinical scenarios of automatic CXR screening and diagnosis tools.

Diabetic retinopathy (DR) grading is crucial in determining the adequate treatment and follow up of patient, but the screening process can be tiresome and prone to errors. Deep learning approaches have shown promising performance as computer-aided diagnosis (CAD) systems, but their black-box behaviour hinders clinical application. We propose DR|GRADUATE, a novel deep learning-based DR grading CAD system that supports its decision by providing a medically interpretable explanation and an estimation of how uncertain that prediction is, allowing the ophthalmologist to measure how much that decision should be trusted. We designed DR|GRADUATE taking into account the ordinal nature of the DR grading problem. A novel Gaussian-sampling approach built upon a Multiple Instance Learning framework allow DR|GRADUATE to infer an image grade associated with an explanation map and a prediction uncertainty while being trained only with image-wise labels. DR|GRADUATE was trained on the Kaggle DR detection training set and evaluated across multiple datasets. In DR grading, a quadratic-weighted Cohen's kappa (κ) between 0.71 and 0.84 was achieved in five different datasets. We show that high κ values occur for images with low prediction uncertainty, thus indicating that this uncertainty is a valid measure of the predictions' quality. Further, bad quality images are generally associated with higher uncertainties, showing that images not suitable for diagnosis indeed lead to less trustworthy predictions. Additionally, tests on unfamiliar medical image data types suggest that DR|GRADUATE allows outlier detection. The attention maps generally highlight regions of interest for diagnosis. These results show the great potential of DR|GRADUATE as a second-opinion system in DR severity grading.

Early diagnosis of lung cancer via computed tomography can significantly reduce the morbidity and mortality rates associated with the pathology. However, searching lung nodules is a high complexity task, which affects the success of screening programs. Whilst computer-aided detection systems can be used as second observers, they may bias radiologists and introduce significant time overheads. With this in mind, this study assesses the potential of using gaze information for integrating automatic detection systems in the clinical practice. For that purpose, 4 radiologists were asked to annotate 20 scans from a public dataset while being monitored by an eye tracker device, and an automatic lung nodule detection system was developed. Our results show that radiologists follow a similar search routine and tend to have lower fixation periods in regions where finding errors occur. The overall detection sensitivity of the specialists was 0.67±0.07, whereas the system achieved 0.69. Combining the annotations of one radiologist with the automatic system significantly improves the detection performance to similar levels of two annotators. Filtering automatic detection candidates only for low fixation regions still significantly improves the detection sensitivity without increasing the number of false-positives.

Image dehazing tries to solve an undesired loss of visibility in outdoor images due to the presence of fog. Recently, machine-learning techniques have shown great dehazing ability. However, in order to be trained, they require training sets with pairs of foggy images and their clean counterparts, or a depth-map. In this paper, we propose to learn the appearance of fog from weakly-labeled data. Specifically, we only require a single label per-image stating if it contains fog or not. Based on the Multiple-Instance Learning framework, we propose a model that can learn from image-level labels to predict if an image contains haze reasoning at a local level. Fog detection performance of the proposed method compares favorably with two popular techniques, and the attention maps generated by the model demonstrate that it effectively learns to disregard sky regions as indicative of the presence of fog, a common pitfall of current image dehazing techniques.

Deep learning models have been successfully used in medical image analysis problems but they require a large amount of labeled images to obtain good performance. However, such large labeled datasets are costly to acquire. Active learning techniques can be used to minimize the number of required training labels while maximizing the model's performance. In this work, we propose a novel sampling method that queries the unlabeled examples that maximize the average distance to all training set examples in a learned feature space. We then extend our sampling method to define a better initial training set, without the need for a trained model, by using Oriented FAST and Rotated BRIEF (ORB) feature descriptors. We validate MedAL on 3 medical image datasets and show that our method is robust to different dataset properties. MedAL is also efficient, achieving 80% accuracy on the task of Diabetic Retinopathy detection using only 425 labeled images, corresponding to a 32% reduction in the number of required labeled examples compared to the standard uncertainty sampling technique, and a 40% reduction compared to random sampling.

The segmentation and characterization of the lung lobes are important tasks for Computer Aided Diagnosis (CAD) systems related to pulmonary disease. The detection of the fissures that divide the lung lobes is non-trivial when using classical methods that rely on anatomical information like the localization of the airways and vessels. This work presents a fully automatic and supervised approach to the problem of the segmentation of the five pulmonary lobes from a chest Computer Tomography (CT) scan using a Fully Regularized V-Net (FRV- Net), a 3D Fully Convolutional Neural Network trained end-to- end. Our network was trained and tested in a custom dataset that we make publicly available. It can correctly separate the lobes even in cases when the fissure is not well delineated, achieving 0.93 in per-lobe Dice Coefficient and 0.85 in the inter-lobar Dice Coefficient in the test set. Both quantitative and qualitative results show that the proposed method can learn to produce correct lobe segmentations even when trained on a reduced dataset.

A new approach for robust edge detection on B-mode ultrasound images of the carotid artery is proposed in this paper. The proposed method uses anisotropic Gaussian derivative filters along with non-maximum suppression over the overall artery wall orientation in local regions. The anisotropic filters allow using a wider integration scale along the edges while preserving the edge location precision. They also perform edge continuation, resulting in the connection of isolated edge points along linear segments, which is a valuable feature for the segmentation of the artery wall layers. However, this usually results in false edges being detected near convex contours and isolated points. The use of non-maximum suppression over pooled local orientations is proposed to solve this issue. Experimental results are provided to demonstrate that the proposed edge detector outperforms other common methods in the detection of the lumen-intima and media-adventia layer interfaces of the carotid vessel walls. Additionally, the resulting edges are more continuous and precisely located.

In medical image analysis applications, the availability of the large amounts of annotated data is becoming increasingly critical. However, annotated medical data is often scarce and costly to obtain. In this paper, we address the problem of synthesizing retinal color images by applying recent techniques based on adversarial learning. In this setting, a generative model is trained to maximize a loss function provided by a second model attempting to classify its output into real or synthetic. In particular, we propose to implement an adversarial autoencoder for the task of retinal vessel network synthesis. We use the generated vessel trees as an intermediate stage for the generation of color retinal images, which is accomplished with a generative adversarial network. Both models require the optimization of almost everywhere differentiable loss functions, which allows us to train them jointly. The resulting model offers an end-to-end retinal image synthesis system capable of generating as many retinal images as the user requires, with their corresponding vessel networks, by sampling from a simple probability distribution that we impose to the associated latent space. We show that the learned latent space contains a well-defined semantic structure, implying that we can perform calculations in the space of retinal images, e.g., smoothly interpolating new data points between two retinal images. Visual and quantitative results demonstrate that the synthesized images are substantially different from those in the training set, while being also anatomically consistent and displaying a reasonable visual quality.

Assessment of retinal vessels is fundamental for the diagnosis of many disorders such as heart diseases, diabetes and hypertension. The imaging of retina using advanced fundus camera has become a standard in computer-assisted diagnosis of opthalmic disorders. Modern cameras produce high quality color digital images, but during the acquisition process the light reflected by the retinal surface generates a luminosity and contrast variation. Irregular illumination can introduce severe distortions in the resulting images, decreasing the visibility of anatomical structures and consequently demoting the performance of the automated segmentation of these structures. In this paper, a novel approach for illumination correction of color fundus images is proposed and applied as preprocessing step for retinal vessel segmentation. Our method builds on the connection between two different phenomena, shadows and haze, and works by removing the haze from the image in the inverted intensity domain. This is shown to be equivalent to correct the nonuniform illumination in the original intensity domain. We tested the proposed method as preprocessing stage of two vessel segmentation methods, one unsupervised based on mathematical morphology, and one supervised based on deep learning Convolutional Neural Networks (CNN). Experiments were performed on the publicly available retinal image database DRIVE. Statistically significantly better vessel segmentation performance was achieved in both test cases when illumination correction was applied.

Given a retinal image, can we automatically determine whether it is of high quality (suitable for medical diagnosis)? Can we also explain our decision, pinpointing the region or regions that led to our decision? Images from human retinas are vital for the diagnosis of multiple health issues, like hypertension, diabetes, and Alzheimer's; low quality images may force the patient to come back again for a second scanning, wasting time and possibly delaying treatment. However, existing retinal image quality assessment methods are either black boxes without explanations of the results or depend heavily on feature engineering or on complex and error-prone anatomical structures' segmentation. Therefore, we propose EyeQual, that solves exactly this problem. EyeQual is novel, fast for inference, accurate and explainable, pinpointing low-quality regions on the image. We evaluated EyeQual on two real datasets where it achieved 100% accuracy taking just 36 milliseconds for each image.

Image quality assessment has been a topic of intense research over the last decades. Although its application to other disciplines is growing tremendously, its use in retinal imaging is still immature and some fundamental challenges remain unsolved. Thus, we present a research methodology for the objective assessment of the quality in retinal images. The methodology can be used as a preliminary step in any computer-aided system, and is composed of four main steps: the location of the region-of-interest, the extraction of relevant image properties and their analysis by feature selection, and the final binary classification into two classes (good and poor quality). The experimental results demonstrate the adequacy of the proposed methodology in this context, being able to objectively assess the quality of retinal images with an accuracy over 99%.

Content-based image retrieval (CBIR) is a search technology that could aid medical diagnosis by retrieving and presenting earlier reported cases that are related to the one being diagnosed. To retrieve relevant cases, CBIR systems depend on supervised learning to map low-level image contents to high-level diagnostic concepts. However, the annotation by medical doctors for training and evaluation purposes is a difficult and time-consuming task, which restricts the supervised learning phase to specific CBIR problems of well-defined clinical applications. This paper proposes a new technique that automatically learns the similarity between the several exams from textual distances extracted from radiology reports, thereby successfully reducing the number of annotations needed. Our method first infers the relation between patients by using information retrieval techniques to determine the textual distances between patient radiology reports. These distances are subsequently used to supervise a metric learning algorithm, that transforms the image space accordingly to textual distances. CBIR systems with different image descriptions and different levels of medical annotations were evaluated, with and without supervision from textual distances, using a database of computer tomography scans of patients with interstitial lung diseases. The proposed method consistently improves CBIR mean average precision, with improvements that can reach 38%, and more marked gains for small annotation sets. Given the overall availability of radiology reports in picture archiving and communication systems, the proposed approach can be broadly applied to CBIR systems in different medical problems, and may facilitate the introduction of CBIR in clinical practice.

The classification of retinal vessels into artery/vein (A/V) is an important phase for automating the detection of vascular changes, and for the calculation of characteristic signs associated with several systemic diseases such as diabetes, hypertension, and other cardiovascular conditions. This paper presents an automatic approach for A/V classification based on the analysis of a graph extracted from the retinal vasculature. The proposed method classifies the entire vascular tree deciding on the type of each intersection point (graph nodes) and assigning one of two labels to each vessel segment (graph links). Final classification of a vessel segment as A/V is performed through the combination of the graph-based labeling results with a set of intensity features. The results of this proposed method are compared with manual labeling for three public databases. Accuracy values of 88.3%, 87.4%, and 89.8% are obtained for the images of the INSPIRE-AVR, DRIVE, and VICAVR databases, respectively. These results demonstrate that our method outperforms recent approaches for A/V classification.

This paper presents an automatic approach for the estimation of Arteriolar-to-Venular Ratio (AVR) in retinal images. The method was assessed using the images of the INSPIRE-AVR database. A mean error of 0.05 was obtained when the method's results were compared with reference AVR values provided with this dataset, thus demonstrating the adequacy of the proposed solution for AVR estimation.

This paper presents a new method for automatic common carotid artery detection in B-mode ultrasonography. The proposed method is based on the location of phase symmetry patterns at apropriate scale of analysis. The local phase information is derived from the monogenic signal and isotropic log-normal band-pass filters, and the resulting common carotid artery is located using a dynamic programming optimization algorithm. The experiments show that the proposed method is more robust to noise than previous approaches, although additional research is required for robust common carotid artery detection on the more complicated cases.

This paper presents two initiatives run by groups of engineering students at the University of Porto: the Microelectronics Students' Group and BioStar. These groups are student-led initiatives that promote different scientific fields through self-guided projects. Both experiences have proven to be very successful in increasing the undergraduate student's interest in science and technology. This work reports the activities, organization and main methodologies employed by these groups, which can be seen as successful approaches to enhance the technical curriculum of students.

Plant development is orchestrated by transcription factors whose expression has become observable in living plants through the use of fluorescence microscopy. However, the exact quantification of expression levels is still not solved and most analysis is only performed through visual inspection. With the objective of automating the quantification of cell nuclei fluorescence we present a new approach to detect cell nuclei in 3D fluorescence confocal microscopy, based on the use of the sliding band convergence filter (SBF). The SBF filter detects cell nuclei and estimate their shape with high accuracy in each 2D image plane. For 3D detection, individual 2D shapes are joined into 3D estimates and then corrected based on the analysis of the fluorescence profile. The final nuclei detection's precision/recall are of 0.779/0.803 respectively, and the average Dice's coefficient of 0.773.

Microscopy cell image analysis is a fundamental tool for biological research. In particular, multivariate fluorescence microscopy is used to observe different aspects of cells in cultures. It is still common practice to perform analysis tasks by visual inspection of individual cells which is time consuming, exhausting and prone to induce subjective bias. This makes automatic cell image analysis essential for large scale, objective studies of cell cultures. Traditionally the task of automatic cell analysis is approached through the use of image segmentation methods for extraction of cells' locations and shapes. Image segmentation, although fundamental, is neither an easy task in computer vision nor is it robust to image quality changes. This makes image segmentation for cell detection semi-automated requiring frequent tuning of parameters. We introduce a new approach for cell detection and shape estimation in multivariate images based on the sliding band filter (SBF). This filter's design makes it adequate to detect overall convex shapes and as such it performs well for cell detection. Furthermore, the parameters involved are intuitive as they are directly related to the expected cell size. Using the SBF filter we detect cells' nucleus and cytoplasm location and shapes. Based on the assumption that each cell has the same approximate shape center in both nuclei and cytoplasm fluorescence channels, we guide cytoplasm shape estimation by the nuclear detections improving performance and reducing errors. Then we validate cell detection by gathering evidence from nuclei and cytoplasm channels. Additionally, we include overlap correction and shape regularization steps which further improve the estimated cell shapes. The approach is evaluated using two datasets with different types of data: a 20 images benchmark set of simulated cell culture images, containing 1000 simulated cells; a 16 images Drosophila melanogaster Kc167 dataset containing 1255 cells, stained for DNA and actin. Both image datasets present a difficult problem due to the high variability of cell shapes and frequent cluster overlap between cells. On the Drosophila dataset our approach achieved a precision/recall of 95%/69% and 82%/90% for nuclei and cytoplasm detection respectively and an overall accuracy of 76%.

The study of cancer cell invasion under the effect of different conditions is fundamental for the understanding of the cancer invasion mechanism and to test possible therapies for its regulation. To simulate invasion across tissue basement membrane, biologists established in vitro assays with cancer cells invading extracellular matrix components. However, analysis of such assays is manual, being timeconsuming and error-prone, which motivates an objective and automated analysis tool. Towards automating such analysis we present a methodology to detect cells in 3D matrix cell assays and correctly estimate their invasion, measured by the depth of the penetration in the gel. Detection is based on the sliding band filter, by evaluating the gradient convergence and not intensity. As such it can detect low contrast cells which otherwise would be lost. For cell depth estimation we present a focus estimator based on the convergence gradients magnitude. The final cell detections precision and recall are of 0.896 and 0.910 respectively, and the average error in the cells position estimate is of 0.41µm, 0.37µm and 3.7µm in the x, y and z directions, respectively.

Automatic biometric identification based on fingerprints is still one of the most reliable identification method in criminal and forensic applications. A critical step in fingerprint analysis without human intervention is to automatically and reliably extract singular points from the input fingerprint images. These singular points (cores and deltas) not only represent the characteristics of local ridge patterns but also determine the topological structure (i.e., fingerprint type) and largely influence the orientation field. Poincare¿ Index-based methods are one of the most common for singular points detection. However, these methods usually result in many spurious detections. Therefore, we propose an enhanced version of the method presented by Zhou et al. [13] that introduced a feature called DORIC to improve the detection. Our principal contribution lies in the adoption of a smoothed orientation field and in the formulation of a new algorithm to analyze the DORIC feature. Experimental results show that the proposed algorithm is accurate and robust, giving better results than the best reported results so far, with improvements in the range of 5% to 7%.

In vivo observation of cells in the Arabidopsis thaliana root, by time-lapse confocal microscopy, is central to biology research. The research herein described is based on large amount of image data, which must be analyzed to determine the location and state of individual cells. Automating the process of cell tracking is an important step to create tools which will facilitate the analysis of cellspsila evolution through time. Here we introduce a confocal tracking system designed in two stages. At the image acquisition stage, we track the area under analysis based on point-to-point correspondences and motion estimation. After image acquisition, we compute cell-to-cell correspondences through time. The final result is a temporal structured information about each cell.

This paper proposes a new framework to image segmentation which combines edge- and region-based information with spectral techniques through the morphological algorithm of watersheds. A pre-processing step is used to reduce the spatial resolution without losing important image information. An initial partitioning of the image into primitive regions is set by applying a rainfalling watershed algorithm on the image gradient magnitude. This initial partition is the input to a computationally efficient region segmentation process which produces the final segmentation. The latter process uses a region-based similarity graph representation of the image regions. The experimental results clearly demonstrate the effectiveness of the proposed approach to produce simpler segmentations and to compare favourably with state-of-the-art methods.

This paper presents an automated method for the segmentation of the vascular network in retinal images. The algorithm starts with the extraction of vessel centerlines, which are used as guidelines for the subsequent vessel filling phase. For this purpose, the outputs of four directional differential operators are processed in order to select connected sets of candidate points to be further classified as centerline pixels using vessel derived features. The final segmentation is obtained using an iterative region growing method that integrates the contents of several binary images resulting from vessel width dependent morphological filters. Our approach was tested on two publicly available databases and its results are compared with recently published methods. The results demonstrate that our algorithm outperforms other solutions and approximates the average accuracy of a human observer without a significant degradation of sensitivity and specificity.

In a classification problem, improved accuracy can be obtained in many situations by using the combination of several classifiers instead of a single one. Turner and Gosh (1999) derived the error reduction that can be obtained by combining unbiased classifiers with independent errors using a simple average. We present an extension of this result by finding the improvement obtained when combining classifiers using weighted average. We also prove that for unbiased classifiers with independent errors the best combination of N classifiers corresponds to a weighted average, where the combination coefficient of each classifier is equal to 1/N. This means that in these cases the simple average should be used. We present experiments illustrating our results.

The cellular neural networks (CNN) model is now a paradigm of cellular analogue programmable multidimensional processor array with distributed local logic and memory. CNNs consist of many parallel analogue processors computing in realtime. One desirable feature is that these processors arranged in a two dimensional grid only have local connections, which lend themselves easily to VLSI implementations. We present a new algorithm for motion estimation using a CNN. We start from a mathematical viewpoint (i.e., statistical regularisation based on a Markov random field) and proceed by mapping the algorithm onto a cellular neural network. Because of the temporal dynamics inherent in the cells of the CNN it is well suited to processing time-varying images. A robust motion estimation algorithm is achieved by using a spatio-temporal neighbourhood for modelling pixel interactions.

In this paper we present an evaluation of optical flow techniques applied to a case study in the perception of visual motion. This case study is being conducted in a project for the evaluation of human factors in road traffic, specifically, concerning the processing of visual information. We present the goals of the case study, discuss the need to apply optical flow techniques to synthesized image sequences and evaluate some limitations encountered in their use.

A 3-D data acquisition and scene segmentation system is described. For 3-D data acquisition a structured light technique based on the ratio of two intensity images is used. This technique avoids the correspondence problem, that appears in other structured light techniques, and allows the acquisition of dense range images. The calibration steps of the system are described. Measurement results with different scenes are presented and system accuracy is evaluated. Taking into account that this system allows the acquisition of a dense range image and an intensity image, registered with it, a new approach to the segmentation of 3-D scenes using both range and intensity information is proposed. The two images are segmented separately and iteratively. At each iteration, the segmentation results are combined. The segmentation proceeds until all segments are planar or no more splits are possible. A two-step merging procedure follows: first, planar surfaces that may have been split are "reconstructed", by merging adjacent planar regions that satisfy some constraints; then, regions belonging to curved surfaces are identified and merged, using a curvature analysis along line segments delimited by edge points, combined from both images. Finally, the resulting surfaces are described, using adequate functions.

Registration methods invariably demand the evaluation of similarity between image areas using criteria based on the maintenance of pixel relative intensities. Because of the severe brightness changes in retinal images, intensity dependent similarity measures are often unable to produce useful registration results. The main purpose of this paper is the presentation of a new similarity evaluation criterion, prepared to overcome the problems raised by important brightness modifications in the images to register. The new criterion is based on the detection of edge point localizations, which are used to assess the correspondence of the compared areas. Some attention was also dedicated to the measure calculation process, and, as an ultimate result, a two-stage implementation was adopted. The values generated by the similarity measure determination step are later used by two registration algorithms prepared to compensate for distinct geometric misalignments between the images.>