Radar imaging provides non-contact, privacy-preserving, and environmentally robust monitoring for continuous human motion recognition (HMR) by leveraging diverse information embedded in various radar signal domains. However, current research has not effectively integrated multi-radar and multi-domain imaging to fully exploit the benefits of distributed radar systems. To bridge this gap, we propose a multi-radar, multi-domain parallel cross-attention model with four key components: intra-domain cross-radar weight sharing encoders specific to each domain for consistent feature extraction and parameter reduction, domain-level parallel cross-attention (DLPCAN) modules to fuse domain-specific features and enhance feature representation robustness in each radar, a source-level attention fusion (SLAF) module to highlight significant features from multiple radar inputs, and two bi-directional gated recurrent unit (BiGRU) modules to capture temporal information. The model is trained using connectionist temporal classification (CTC) loss for effective sequence prediction. By integrating data from multiple radar nodes and domains, our approach significantly improves continuous HMR performance compared to single radar systems and single domain data. Comparative evaluations demonstrate that our model outperforms state-of-the-art radar imaging-based HMR solutions.

White matter microstructure plays a pivotal role in the diagnosis and study of brain disorders. Deep learning-based estimation of white matter microstructural indices from diffusion MRI (dMRI) data has gained increasing research attention in recent years. To conduct effective learning in the heterogeneous space (i.e., x-space and q-space) of dMRI data, hybrid neural networks were proposed and have shown great potential. To this end, we propose a new hybrid neural network, called synergistic dual-path hybrid convolutional neural network (SDH-Net), for more effective microstructure estimation. In our SDH-Net, we propose a dual-path architecture that takes bidirectional asymmetric learning in x-space and q-space to enhance feature representation in heterogeneous domains. Firstly, 3D patches are extracted from each diffusion gradient as vertices, and then a graph is constructed based on the correlation between diffusion angles. In the x-q learning branch, an effective representation is embedded in x-space to enhance learning in q-space, while vice versa in the q-x learning branch. Extensive experiments on data from the human connectome project demonstrate that our SDH-Net outperforms the existing state-of-the-art models.

Diffusion magnetic resonance imaging (dMRI), as a powerful non-invasive white matter imaging technology, plays an important role in studying brain white matter. The fiber orientation distribution functions (fODFs) derived from dMRI data provide the key directional information of fiber tracts for revealing the 3D geometric structure of brain white matter. The estimation of fODFs faces two challenges, including (i) the demand for dMRI data densely sampled in q-space and (ii) the joint consideration of x-q space. To address these challenges, we propose a mixture learning framework with q-space sparely sampled dMRI data as input. Specifically, we propose an x-space learning module based on 3D U-Net to learn x-space features and a q-space learning module based on spherical convolutional neural networks to learn q-space features. Two kinds of features are then fused with a mixture learning fusion module for fODFs estimation. The whole framework is supervised with an x-q space loss function. Our framework makes full use of joint x-q space information for fODFs estimation with clinically available q-space sparsely sampled dMRI data. Extensive experiments on three public datasets show that our framework is effective in fODFs estimation and outperforms cutting-edge models.

As a powerful microstructural imaging technique, neurite orientation dispersion and density imaging (NODDI) provides detailed insights into brain microstructures. Its clinical application is often restricted by the necessity for high-quality scanning, which can be challenging to achieve in practical settings. To overcome this limitation, we propose an innovative 3D conditional latent diffusion model (3D-CLDM) to generate high-quality NODDI index maps from low-resolution diffusion magnetic resonance imaging data. The 3D-CLDM is a two-stage super-resolved microstructure estimation model that includes training a vector quantized generative adversarial network and a diffusion model. It leverages the sophisticated high-dimensional data modeling capabilities of the conditional latent diffusion model to effectively capture and represent intricate microstructural features that are difficult to detect with conventional techniques. We conducted comprehensive experiments using data from the human connectome project to rigorously assess our model’s performance. The results reveal that our approach not only significantly improves the quality of super-resolved microstructural estimation but also surpasses current state-of-the-art models in both qualitative and quantitative evaluations. This highlights the potential of 3D-CLDM to advance brain microstructure imaging, making it more feasible and effective for clinical applications.

Low resolution is a major issue restricting the application of Diffusion-Weighted Imaging (DWI) in neuroscience research and clinical routine. Super-resolution provides a viable solution to enhance the resolution of DWIs at the post-acquisition stage. Existing methods for DWI super-resolution primarily rely on the information in the x-space (i.e., spatial domain), but fail in exploiting the angular relationships in q-space (i.e., diffusion wavevector domain). In this work, we propose a Unified X-Q space Learning (UXQL) framework that makes full use of x-space and q-space information. Building upon a message-passing scheme, we employ 3D residual convolutional blocks to learn correlations in x-space, while utilizing a spatial attention mechanism to achieve effective q-space learning. Additionally, the T1-w MR image is incorporated into our framework for additional information to assist DWI super-resolution. We conduct experiments on the DWIs from the widely-used Human Connectome Project (HCP). Experimental results demonstrate the effectiveness of UXQL in improving DWI super-resolution, both quantitatively and qualitatively.

The open neuroimaging datasets provided by researchers offer a wealth of samples for scientific research, enhancing reproducibility and accelerating new scientific discoveries. However, due to privacy concerns and the costs of data management, researchers often release data that has been processed using atlases. Nevertheless, releasing such data has some limitations, especially in the field of connectomics. Different studies may use different atlases, leading to brain connectivity data that is not directly comparable across studies. Additionally, since there is no universally accepted standard atlas, researchers have to compromise on atlas selection, which may not meet the needs of all studies. To address these limitations, we propose a cross-atlas brain connectivity mapping framework based on a dual-conditional diffusion model, which can generate brain connectivity corresponding to a target atlas given only the brain connectivity corresponding to an original atlas. We introduce the first deep learning framework for cross-atlas brain connectivity mapping and demonstrate its effectiveness through experiments. We also validate the effectiveness of the dual-conditional diffusion model through ablation experiments, showing that adding additional conditional information provides a richer source of guidance.

Cancer is widely recognized as the primary cause of mortality worldwide, and pathology analysis plays a pivotal role in achieving accurate cancer diagnosis. The intricate representation of features in histopathological images encompasses abundant information crucial for disease diagnosis, regarding cell appearance, tumor microenvironment, and geometric characteristics. However, recent deep learning methods have not adequately exploited geometric features for pathological image classification due to the absence of effective descriptors that can capture both cell distribution and gathering patterns, which often serve as potent indicators. In this paper, inspired by clinical practice, a Hierarchical Graph Pyramid Transformer (HGPT) is proposed to guide pathological image classification by effectively exploiting a geometric representation of tissue distribution which was ignored by existing state-of-the-art methods. First, a graph representation is constructed according to morphological feature of input pathological image and learn geometric representation through the proposed multi-head graph aggregator. Then, the image and its graph representation are feed into the transformer encoder layer to model long-range dependency. Finally, a locality feature enhancement block is designed to enhance the 2D local representation of feature embedding, which is not well explored in the existing vision transformers. An extensive experimental study is conducted on Kather-5K, MHIST, NCT-CRC-HE, and GasHisSDB for binary or multi-category classification of multiple cancer types. Results demonstrated that our method is capable of consistently reaching superior classification outcomes for histopathological images, which provide an effective diagnostic tool for malignant tumors in clinical practice.

The rapidly emerging field of deep learning-based computational pathology has shown promising results in utilizing whole slide images (WSIs) to objectively prognosticate cancer patients. However, most prognostic methods are currently limited to either histopathology or genomics alone, which inevitably reduces their potential to accurately predict patient prognosis. Whereas integrating WSIs and genomic features presents three main challenges: (1) the enormous heterogeneity of gigapixel WSIs which can reach sizes as large as 150,000×150,000 pixels; (2) the absence of a spatially corresponding relationship between histopathology images and genomic molecular data; and (3) the existing early, late, and intermediate multimodal feature fusion strategies struggle to capture the explicit interactions between WSIs and genomics. To ameliorate these issues, we propose the Mutual-Guided Cross-Modality Transformer (MGCT), a weakly-supervised, attention-based multimodal learning framework that can combine histology features and genomic features to model the genotype-phenotype interactions within the tumor microenvironment. To validate the effectiveness of MGCT, we conduct experiments using nearly 3,600 gigapixel WSIs across five different cancer types sourced from The Cancer Genome Atlas (TCGA). Extensive experimental results consistently emphasize that MGCT outperforms the state-of-the-art (SOTA) methods.

Identifying enhancers is a critical task in bioinformatics due to their primary role in regulating gene expression. For this reason, various computational algorithms devoted to enhancer identification have been put forward over the years. More features are extracted from the single DNA sequences to boost the performance. Nevertheless, DNA structural information is neglected, which is an essential factor affecting the binding preferences of transcription factors to regulatory elements like enhancers. Here, we propose SENIES, a DNA shape enhanced deep learning predictor, to identify enhancers and their strength. The predictor consists of two layers where the first layer is for enhancer and non-enhancer identification, and the second layer is for predicting the strength of enhancers. Apart from two common sequence-derived features (i.e., one-hot and k-mer), DNA shape is introduced to describe the 3D structures of DNA sequences. Performance comparison with state-of-the-art methods conducted on public datasets demonstrates the effectiveness and robustness of our predictor. The code implementation of SENIES is publicly available at https://github.com/hlju-liye/SENIES.

How to exploit useful features to enhance the quality of blurred images is a long-standing topic in single image deblurring. Existing learning-based approaches show exciting performance by increasing the receptive fields depending on multi-scale and scale recurrent strategy. However, it is still a challenging task for deblurring to enlarge the receptive field only relying on increasing the number of layers of a neural network. To tackle this challenge, we propose a multi-scale spatial and edge attention enhanced model (MSEA) for image deblurring. Firstly, edge features are extracted to guide the network's attention to the recovery of fine details and texture information. Then we introduce spatial attention fusion mechanism for the adaptive fusion of features derived from edge maps and blurry images, and those representing shallow fine-grained details and in-depth abstract features. Qualitative and quantitative evaluation results over GoPro and VideoDeblurring datasets demonstrated the improved performance, especially when there are sharp edges and rich textures.