Computer-aided diagnosis (CAD) technology can assist clinicians in evaluating liver lesions and intervening with treatment in time. Although CAD technology has advanced in recent years, the application scope of existing datasets remains relatively limited, typically supporting only single tasks, which has somewhat constrained the development of CAD technology. To address the above limitation, in this paper, we construct a multi-task liver dataset (LiMT) used for liver and tumor segmentation, multi-label lesion classification, and lesion detection based on arterial phase-enhanced computed tomography (CT), potentially providing an exploratory solution that is able to explore the correlation between tasks and does not need to worry about the heterogeneity between task-specific datasets during training. The dataset includes CT volumes from 150 different cases, comprising four types of liver diseases as well as normal cases. Each volume has been carefully annotated and calibrated by experienced clinicians. This public multi-task dataset may become a valuable resource for the medical imaging research community in the future. In addition, this paper not only provides relevant baseline experimental results but also reviews existing datasets and methods related to liver-related tasks.

Medical Visual Question Answering (Med-VQA) models often suffer from language bias, which relies on linguistic cues to predict answers instead of understanding image content, limiting model performance. To address this, we propose DeCI, a novel causally-inspired intervention scheme to mitigate language bias in Med-VQA tasks. Specifically, DeCI incorporates two debiasing modules: a keyword-based fine-grained debiasing module to eliminate spurious correlations between clinical terms and answers, and a keyword-guided visual enhancement module to focus on key regions without requiring manual annotations. Experimental results on two public datasets and their bias-sensitive variants demonstrate that DeCI outperforms existing state-of-the-art Med-VQA models, achieving significant improvements in accuracy.

The success of deep learning in 3D medical image segmentation hinges on training with a large dataset of fully annotated 3D volumes, which are difficult and time-consuming to acquire. Although recent foundation models (e.g., segment anything model, SAM) can utilize sparse annotations to reduce annotation costs, segmentation tasks involving organs and tissues with blurred boundaries remain challenging. To address this issue, we propose a region uncertainty estimation framework for Computed Tomography (CT) image segmentation using noisy labels. Specifically, we propose a sample-stratified training strategy that stratifies samples according to their varying quality labels, prioritizing confident and fine-grained information at each training stage. This sample-to-voxel level processing enables more reliable supervision information to propagate to noisy label data, thus effectively mitigating the impact of noisy annotations. Moreover, we further design a boundary-guided regional uncertainty estimation module that adapts sample hierarchical training to assist in evaluating sample confidence. Experiments conducted across multiple CT datasets demonstrate the superiority of our proposed method over several competitive approaches under various noise conditions. Our proposed reliable label propagation strategy not only significantly reduces the cost of medical image annotation and robust model training but also improves the segmentation performance in scenarios with imperfect annotations, thus paving the way towards the application of medical segmentation foundation models under low-resource and remote scenarios. Code will be available at https://github.com/KHan-UJS/NoisyLabel.

Accurate segmentation of organs and tumors is crucial for clinical diagnosis. Deep learning methods have been widely applied to various medical image segmentation tasks. However, these methods often suffer from the foreground and background class imbalance challenge when dealing with small regions of interest. To address this limitation, we propose a Wavelet Transform-based Distribution Discrepancy Maximization (WT-DDM) framework for medical image segmentation. Specifically, we first introduce a Distribution Discrepancy Maximization (DDM) module that makes the model on the foreground region from abundant irrelevant background. Then, the Wavelet Transform-based Feature Enhancement (WTFE) module was applied to mine the texture details of the foreground object. Experiments on multiple popular medical image segmentation datasets demonstrate that our framework yields highly competitive segmentation results.

Knowledge distillation transfers knowledge from the teacher model to the student one, significantly enhancing the capabilities of the student network. However, alleviating the information gap between the corresponding stages of the student and teacher during the distillation process poses a challenge. This challenge is particularly noticeable at deeper levels, where the limited capability of the student may result in capturing less information, thus leading to poor learning performance. To overcome this limitation, we introduce a novel multi-stage local feature distillation method, which leverages fused multiple feature maps named tutor to bridge the gap. Additionally, we have designed the Value Attention-Based Fusion module (Value-ABF) to enhance feature fusion reasonably. Compared with other distillation methods, our approach achieves comparable or even superior results and demonstrates better training efficiency on CIFAR-100 and COCO2017 datasets for tasks such as image classification, object detection, and instance segmentation.

Automated and accurate segmentation of medical images is important for facilitating clinical diagnosis and treatment. Currently, state-of-the-art(SOTA) diffusion based medical image segmentation methods are hampered by inherent randomness when generating diffusion model outcomes. Multiple generations are required to mitigate this randomness, which present a challenge for diffusion models. Due to the extended inference time required by diffusion models for multistep iterations, the process of obtaining final segmentation results by multiple generations is prolonged. As a result, this hampers the application of diffusion models in the medical field and limits the research potential of these models. In this paper, we present a medical image segmentation framework that concurrently predicts labels and noise. By leveraging label constraints within the diffusion model, we effectively suppress randomness, enabling the generation of segmentation maps with reduced errors in the initial stages and thereby suppress randomness. The performance of the proposed method is assessed using the ISIC2016 and Brats2018 datasets. Our approach necessitates just a single generation to produce effective segmentation results without the need for multiple steps to mitigate randomness and outperforms compared SOTA methods.

Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter-cascade generative adversarial network, namely JAS-GAN, to segment the unbalanced atrial targets from LGE CMR images automatically and accurately in an end-to-end way. Firstly, JAS-GAN investigates an adaptive attention cascade to automatically correlate the segmentation tasks of the unbalanced atrial targets. The adaptive attention cascade mainly models the inclusion relationship of the two unbalanced atrial targets, where the estimated LA acts as the attention map to adaptively focus on the small atrial scars roughly. Then, an adversarial regularization is applied to the segmentation tasks of the unbalanced atrial targets for making a consistent optimization. It mainly forces the estimated joint distribution of LA and atrial scars to match the real ones. We evaluated the performance of our JAS-GAN on a 3D LGE CMR dataset with 192 scans. Compared with the state-of-the-art methods, our proposed approach yielded better segmentation performance (Average Dice Similarity Coefficient (DSC) values of 0.946 and 0.821 for LA and atrial scars, respectively), which indicated the effectiveness of our proposed approach for segmenting unbalanced atrial targets.

Semi-supervised learning provides great significance in left atrium (LA) segmentation model learning with insufficient labelled data. Generalising semi-supervised learning to cross-domain data is of high importance to further improve model robustness. However, the widely existing distribution difference and sample mismatch between different data domains hinder the generalisation of semi-supervised learning. In this study, we alleviate these problems by proposing anAdaptive Hierarchical Dual Consistency(AHDC) for the semi-supervised LA segmentation on cross-domain data. The AHDC mainly consists of a Bidirectional Adversarial Inference module (BAI) and a Hierarchical Dual Consistency learning module (HDC). The BAI overcomes the difference of distributions and the sample mismatch between two different domains. It mainly learns two mapping networks adversarially to obtain two matched domains through mutual adaptation. The HDC investigates a hierarchical dual learning paradigm for cross-domain semi-supervised segmentation based on the obtained matched domains. It mainly builds two dual-modelling networks for mining the complementary information in both intra-domain and inter-domain. For the intra-domain learning, a consistency constraint is applied to the dual-modelling targets to exploit the complementary modelling information. For the inter-domain learning, a consistency constraint is applied to the LAs modelled by two dual-modelling networks to exploit the complementary knowledge among different data domains. We demonstrated the performance of our proposed AHDC on four 3D late gadolinium enhancement cardiac MR (LGE-CMR) datasets from different centres and a 3D CT dataset. Compared to other state-of-the-art methods, our proposed AHDC achieved higher segmentation accuracy, which indicated its capability in the cross-domain semi-supervised LA segmentation.

Three-dimensional late gadolinium enhanced (LGE) cardiac MR (CMR) of left atrial scar in patients with atrial fibrillation (AF) has recently emerged as a promising technique to stratify patients, to guide ablation therapy and to predict treatment success. This requires a segmentation of the high intensity scar tissue and also a segmentation of the left atrium (LA) anatomy, the latter usually being derived from a separate bright-blood acquisition. Performing both segmentations automatically from a single 3D LGE CMR acquisition would eliminate the need for an additional acquisition and avoid subsequent registration issues. In this paper, we propose a joint segmentation method based on multiview two-task (MVTT) recursive attention model working directly on 3D LGE CMR images to segment the LA (and proximal pulmonary veins) and to delineate the scar on the same dataset. Using our MVTT recursive attention model, both the LA anatomy and scar can be segmented accurately (mean Dice score of 93% for the LA anatomy and 87% for the scar segmentations) and efficiently (∼0.27 s to simultaneously segment the LA anatomy and scars directly from the 3D LGE CMR dataset with 60–68 2D slices). Compared to conventional unsupervised learning and other state-of-the-art deep learning based methods, the proposed MVTT model achieved excellent results, leading to an automatic generation of a patient-specific anatomical model combined with scar segmentation for patients in AF.