Cell nuclei segmentation in histopathological images is essential for diagnosing oral epithelial dysplasia, a condition associated with an increased risk of oral cancer. Deep learning models have demonstrated significant potential in this task, but challenges persist due to variations in staining, tissue morphology, and artifacts. This study investigates segmentation models and proposes ensemble approaches to improve instance segmentation in OED histological images. The ensemble integrates diverse segmentation models using different voting rules, with the$D_{C^{-}}$weighted averaging achieving the best results. The proposed method obtained an accuracy of$\mathbf{9 4. 0 9 \%}$and a Dice coefficient of 0.9461, surpassing individual models and demonstrating significant improvement. Comparative analysis with the literature shows that the ensemble achieved competitive performance across multiple datasets. These results reinforce the potential of ensemble learning to enhance segmentation accuracy, contributing to the development of robust computer-aided diagnosis systems.

Cancer is a major health concern in Brazil and globally and is characterized by its high incidence and mortality rates. Diagnosis typically involves the preparation and microscopic analysis of tissue samples, which are often stained with hematoxylin and eosin (H&E). However, color variation in these images poses a significant challenge for computeraided diagnosis systems. This study explored dictionary learning techniques for H&E stain color normalization by utilizing public histological image datasets with varying colors for performance comparisons. The findings revealed that the non-negative matrix factorization techniques outperformed existing methods in the literature, particularly in feature preservation, achieving maximum FSIM, PSNR, QSSIM, and SSIM values of approximately 0.82, 40.21, 0.84, and 0.93, respectively. Furthermore, the impact of normalization on nuclear segmentation highlighted that the visual quality of the normalized images did not directly correlate with the quantitative segmentation results. Therefore, this study raises important open questions for the development of future research in this area.

Early diagnosis of potentially malignant disorders, such as oral epithelial dysplasia (OED), is the most reliable way to prevent oral cancer. Computational algorithms have been used as a tool to aid specialists in this process. In recent years, CNN-based methods have gained more attention due to their improved results in nuclei segmentation tasks. Despite these relevant results, achieving high segmentation accuracy remains a challenging task. In this paper, we propose an ensemble of segmentation models to improve the performance of nuclei segmentation in OED histopathology images. The proposed ensemble consists of four CNN segmentation models, which were combined using three ensemble strategies: simple averaging, weighted averaging and majority voting, achieved accuracy of 90.69%, 90.70% and 88.49%, respectively, when applied to OED images. The model's performance was also evaluated on three publicly available datasets and achieved comparable performance to state-of-the-art segmentation methods. These values indicate that the proposed ensemble methods can be used in medical image analysis applications.

Oral epithelial dysplasia is a common type of pre-cancerous lesion that can be categorized as mild, moderate and severe. The manual diagnosis of this type of lesion is a time consuming and complex task. The use of digital systems applied to microscopic image analysis can aid the decision making of specialists. In recent years, deep learning-based methods are getting more attention due to its improved results in nuclei segmentation tasks. In this paper, we propose a methodology for nuclei segmentation on images of dysplastic tissues using neural networks. Several optimization algorithms and color normalization methods were evaluated. The methodology was performed on a dataset of mice tongue images. The experimental evaluations showed that the Nadam optimizer in combination with images without the use of color normalization obtained the best results. The method was able to segment the images with an average accuracy of 0.887, the sensitivity of 0.762 and specificity of 0.942. The algorithm was compared to other segmentation methods and showed relevant results. These values indicate that the proposed method can be used as a tool to aid specialists in the nuclei analysis of histological images of the buccal cavity.

Histological images analysis is widely used to carry out diagnoses of different types of cancer. Digital image processing methods can be used for this purpose, leading to more objective diagnoses. Segmentation techniques are applied to identify cellular structures indicative of diseases. In addition, the extracted features from these specific regions can aid pathologists in diagnoses decision using classification techniques. In this paper, we present an evaluation of evolutionary algorithms applied to lymphoma images for segmentation of their neoplastic cellular nuclei. In a second stage, we investigated the performance of the segmented images in the classification step. Initially, the R channel from RGB color model was processed with histogram equalization and Gaussian filter. In the segmentation step, optimization methods were analyzed in combination with the fuzzy 3-partition technique. Then, we also applied the valley-emphasis method and morphological operations to remove false positive regions in the post-processing step. Intensity and texture features were extracted and classified by the support vector machine method for diagnoses of 62 and 99 images of follicular lymphoma and mantle cell lymphoma, respectively. The results were evaluated through qualitative and quantitative analyses and the differential evolution method has reached the best results in the segmentation step. This technique allowed a relevant performance on the classification task with a mean value of accuracy of 99.38%.

Non-Hodgkin lymphoma is the most common cancer of the lymphatic system and should be considered as a group of several closely related cancers, which can show differences in their growth patterns, their impact on the body and how they are treated. The diagnosis of the different types of neoplasia is made by a specialist through the analysis of histological images. However, these analyses are complex and the same case can lead to different understandings among pathologists, due to the exhaustive analysis of decisions, the time required and the presence of complex histological features. In this context, computational algorithms can be applied as tools to aid specialists through the application of segmentation methods to identify regions of interest that are essential for lymphomas diagnosis. In this paper, an unsupervised method for segmentation of nuclear components of neoplastic cells is proposed to analyze histological images of lymphoma stained with hematoxylin-eosin. The proposed method is based on the association among histogram equalization, Gaussian filter, fuzzy 3-partition entropy, genetic algorithm, morphological techniques and the valley-emphasis method in order to analyze neoplastic nuclear components, improve the contrast and illumination conditions, remove noise, split overlapping cells and refine contours. The results were evaluated through comparisons with those provided by a specialist and techniques available in the literature considering the metrics of accuracy, sensitivity, specificity and variation of information. The mean value of accuracy for the proposed method was 81.48%. Although the method obtained sensitivity rates between 41% and 51%, the accuracy values showed relevance when compared to those provided by other studies. Therefore, the novelties presented here may already encourage new studies with a more comprehensive overview of lymphoma segmentation.