Brain disorders are associated with impairments in cognitive and social functioning, placing a substantial burden on families, healthcare systems, and communities. However, accurate diagnosis remains challenging due to complex higher order interactions among brain regions. Existing graph-based methods are largely limited to pairwise connectivity. In addition, these methods often fail to fully exploit well-established neuroscientific prior knowledge, resulting in limited biological interpretability and suboptimal diagnostic performance. Therefore, we propose a prior knowledge-guided adaptive hypergraph learning (PK-AHGL) framework that represents individual-level functional connectivity networks as hypergraphs to capture higher order multiregion interactions while incorporating neuroscientific prior knowledge for brain disorder diagnosis. PK-AHGL consists of three key modules: 1) an adaptive hypergraph convolution module. Unlike traditional hypergraph neural networks that use static hyperedge weights, this module adaptively learns the weights of different hyperedges; 2) a sparse affinity Laplacian module. Key brain regions are extracted from disorder related functional brain networks and used as prior knowledge. Based on these regions, we compute a hyperedge similarity matrix that encourages similar hyperedges to have similar weights; and 3) a proportional margin ranking module. This module further utilizes prior knowledge by guiding hyperedges containing a higher proportion of key brain regions to obtain larger weights. Experiments on autism brain imaging data exchange (ABIDE), Strategic Research Program for the Promotion of Brain Science (SRPBS)-schizophrenia (SCZ), SRPBS-major depressive disorder (MDD), and Alzheimer’s disease neuroimaging initiative (ADNI) show that PK-AHGL achieves accuracies of 75.78%, 82.66%, 74.89%, and 77.22%, respectively, outperforming multiple state-of-the-art methods. These results suggest that PK-AHGL provides an effective auxiliary tool for brain disorder diagnosis and may support community-oriented mental health services.

Pathological diagnosis assists in saving human lives, but such models are annotation hungry and pathological images are notably expensive to annotate. Contrastive learning could be a promising solution that relies only on the unlabeled training data to generate informative representations. However, the majority of current methods in contrastive learning have the following two issues: (1) positive samples produced through random augmentation are less challenging, and (2) false negative pairs problem caused by negative sampling bias. To alleviate the above issues, we propose a novel contrastive learning method called Cluster-Aware Adversarial Contrastive Learning (CA2CL). Specifically, a mixed data augmentation technique is provided to learn more transferable representations by generating more discriminative sample pairs. Furthermore, to mitigate the effects of inherent false negative pairs, we adopt a cluster-aware loss to identify similarities between instances and incorporate them into the process of contrastive learning. Finally, we generate challenging contrastive data pairs by adversarial learning, and adversarially learn robust representations in the representation space without the labeled training data, which aims to maximize the similarity between the augmented sample and the related adversarial sample. Our proposed CA2CL is evaluated on two public datasets: NCT-CRC-HE and PCam for the fine-tuning and linear evaluation tasks and on two other public datasets: GlaS and CARG for the detection and segmentation tasks, respectively. Extensive experimental results demonstrate the superior performance improvement of our method over several Self-supervised learning (SSL) methods and ImageNet pretraining particularly in scenarios with limited data availability for all four tasks.

Chinese electronic medical record (EMR) presents significant challenges for named entity recognition (NER) due to their specialized nature, unique language features, and diverse expressions. Traditionally, NER is treated as a sequence labeling task, where each token is assigned a label. Recent research has reframed NER within the machine reading comprehension (MRC) framework, extracting entities in a question-answer format, achieving state-of-the-art performance. However, these MRC-based methods have a significant limitation: they extract entities of various types independently, ignoring their interrelations. To address this, we introduce the Fusion Label Relations with MRC (FLR-MRC) model, which enhances the MRC model by implicitly capturing dependencies among entity types. FLR-MRC models interrelations between labels using graph attention networks, integrating these with textual data to identify entities. On the benchmark CMeEE and CCKS2017-CNER datasets, FLR-MRC achieves F1-scores of 0.6652 and 0.9101, respectively, outperforming existing clinical NER methods.

Self-supervised learning provides a possible solution to extract effective visual representations from unlabeled pathological images. However, most of the existing methods either do not effectively utilize domain-specific information or are designed and optimized for image classification, resulting in these pre-trained models that may not be optimal for pathological image segmentation. In this paper, we propose DKSL: Domain-specific Knowledge guided Self-supervised Learning, which uses image reconstruction tasks to aid contrastive learning and exploits single-dye stained pathological images after stain separation as domain-specific knowledge to guide the model. Our method provides a novel way to exploit the domain-specific knowledge of pathological images. In contrastive learning, we add single-dye stained images as an expansion of the original positive samples to the contrastive learning process to preserve more global semantic information. In image reconstruction, the model is forced to focus on local image details relevant to downstream tasks by reconstructing single-dye stained images from the representation extracted by the encoder of contrastive learning. Finally, the encoder and decoder from the pre-training stage are fine-tuned by the downstream segmentation task. Fine-tuning experimental results demonstrate that DKSL outperforms state-of-the-art methods with Dices of 90.50% and 79.68% on two publicly available datasets, GlaS and MoNuSeg, respectively.

Accurately predicting survival of esophageal cancer is essential for clinical precision treatment. However, the existing region of interest (ROI) based methods not only require prior medical knowledge to complete the delineation of tumor, but may also lead to excessive sensitivity of the model towards ROI. To address these challenges, we design a fully automated CT-guided learning that combines a CNN-Transformer size aware U-Net and a ranked survival prediction network together to automatically predict the survival of patients with esophageal cancer. Specifically, we first incorporate the Transformer with shifted windowing multi-head self-attention mechanism into the base of the encoder in the U-Net to capture the long-range dependency in the 3D CT images. Then, to alleviate the imbalance between the ROI and the background in CT images, we design a size-aware coefficient for the segmentation loss. Finally, we design a ranked pair sorting loss to learn more fully the ranked information hidden in esophageal cancer patients. To validate the effectiveness of our method, we conduct extensive experiments on a dataset containing 759 esophageal cancer samples. The experimental results demonstrate that our proposed method can still achieve the best performance in survival prediction without ROI ground truth.

The accurate prediction of glioma grade before surgery is essential for treatment planning and prognosis. Since the gold standard (i.e., biopsy)for grading gliomas is both highly invasive and expensive, and there is a need for a noninvasive and accurate method. In this study, we proposed a novel radiomics-based pipeline by incorporating the intratumoral and peritumoral features extracted from preoperative mpMRI scans to accurately and noninvasively predict glioma grade. To address the unclear peritumoral boundary, we designed an algorithm to capture the peritumoral region with a specified radius. The mpMRI scans of 285 patients derived from a multi-institutional study were adopted. A total of 2153 radiomic features were calculated separately from intratumoral volumes (ITVs)and peritumoral volumes (PTVs)on mpMRI scans, and then refined using LASSO and mRMR feature ranking methods. The top-ranking radiomic features were entered into the classifiers to build radiomic signatures for predicting glioma grade. The prediction performance was evaluated with five-fold cross-validation on a patient-level split. The radiomic signatures utilizing the features of ITV and PTV both show a high accuracy in predicting glioma grade, with AUCs reaching 0.968. By incorporating the features of ITV and PTV, the AUC of IPTV radiomic signature can be increased to 0.975, which outperforms the state-of-the-art methods. Additionally, our proposed method was further demonstrated to have strong generalization performance in an external validation dataset with 65 patients. The source code of our implementation is made publicly available at https://github.com/chengjianhong/glioma_grading.git.

Accurate and rapid diagnosis of coronavirus disease 2019 (COVID-19) from chest CT scans is of great importance and urgency during the worldwide outbreak. However, radiologists have to distinguish COVID-19 pneumonia from other pneumonia in a large number of CT scans, which is tedious and inefficient. Thus, it is urgently and clinically needed to develop an efficient and accurate diagnostic tool to help radiologists to fulfill the difficult task. In this study, we proposed a deep supervised autoencoder (DSAE) framework to automatically identify COVID-19 using multi-view features extracted from CT images. To fully explore features characterizing CT images from different frequency domains, DSAE was proposed to learn the latent representation by multi-task learning. The proposal was designed to both encode valuable information from different frequency features and construct a compact class structure for separability. To achieve this, we designed a multi-task loss function, which consists of a supervised loss and a reconstruction loss. Our proposed method was evaluated on a newly collected dataset of 787 subjects including COVID-19 pneumonia patients, other pneumonia patients, and normal subjects without abnormal CT findings. Extensive experimental results demonstrated that our proposed method achieved encouraging diagnostic performance and may have potential clinical application for the diagnosis of COVID-19.

Effective fusion of multimodal magnetic resonance imaging (MRI) is of great significance to boost the accuracy of glioma grading thanks to the complementary information provided by different imaging modalities. However, how to extract the common and distinctive information from MRI to achieve complementarity is still an open problem in information fusion research. In this study, we propose a deep neural network model termed as multimodal disentangled variational autoencoder (MMD-VAE) for glioma grading based on radiomics features extracted from preoperative multimodal MRI images. Specifically, the radiomics features are quantized and extracted from the region of interest for each modality. Then, the latent representations of variational autoencoder for these features are disentangled into common and distinctive representations to obtain the shared and complementary data among modalities. Afterwards, cross-modality reconstruction loss and common-distinctive loss are designed to ensure the effectiveness of the disentangled representations. Finally, the disentangled common and distinctive representations are fused to predict the glioma grades, and SHapley Additive exPlanations (SHAP) is adopted to quantitatively interpret and analyze the contribution of the important features to grading. Experimental results on two benchmark datasets demonstrate that the proposed MMD-VAE model achieves encouraging predictive performance (AUC:0.9939) on a public dataset, and good generalization performance (AUC:0.9611) on a cross-institutional private dataset. These quantitative results and interpretations may help radiologists understand gliomas better and make better treatment decisions for improving clinical outcomes.

Epidermal growth factor receptor (EGFR) genotyping is essential to treatment guidelines for the use of tyrosine kinase inhibitors in lung adenocarcinoma. However, accurate and noninvasive methods to detect the EGFR gene are ongoing challenges. In this study, we propose a hybrid framework, namely HC-DLR, to noninvasively predict EGFR mutation status by fusing multi-source features including low-level handcrafted radiomics (HCR) features, high-level deep learning-based radiomics (DLR) features, and demographics features. The HCR features first are selected from massive handcrafted features extracted from CT images. The DLR features are also extracted from CT images using the pre-trained 3D DenseNet. Then, multi-source feature representations are refined and fused to build an HC-DLR model for improving the predictive performance of EGFR mutations. The proposed method is evaluated on a newly collected dataset with 670 patients. Experimental results show that the HC-DLR model achieves an encouraging predictive performance with an AUC of 0.76, an accuracy of 72.47%, and an F1-score of 71.35%, which may have potential clinical value for predicting EGFR mutations in lung adenocarcinoma.