Facial Action Unit (AU) recognition involves identifying subtle muscle movements corresponding to different AUs. Recent approaches have focused on localizing AUs using predefined Regions of Interest (RoIs) or learnable modules. However, these methods either overly depend on the precision of predefined RoIs or inaccurately localize background regions instead of the actual AU positions. To address this challenge, we propose a novel method, which automatically localizes each AU without relying on predefined RoIs or introducing learnable modules during the inference phase. Specifically, our approach decomposes the task into two subtasks: AU localization and AU state verification. We first align the direction between spatial features and the corresponding AU class weights to guide the model in localizing AUs. Next, we incorporate spatial and temporal aspects for precise AU state detection. From the perspective of spatial information learning, we propose a confidence-based AU relationship mining module that directs the model to focus on uncertain AUs. From the aspect of temporal information learning, we introduce a temporal sampling strategy that implicitly captures time-dependent features. Experimental results on the BP4D and DISFA datasets demonstrate the effectiveness of our method, showing that it outperforms existing approaches and achieves state-of-the-art performance in AU recognition.

Weakly supervised semantic segmentation (WSSS) leverages weak annotations to train semantic segmentation networks, thereby reducing the cost of pixel-level labeling. However, prevalent WSSS methods rely on Class Activation Map (CAM), which only focus on the most discriminative parts of a class, resulting in incomplete and inaccurate pseudo-labels. To resolve this, we propose a Beta Modulation (BM) method, which introduces multiple fixed forms of the Beta distribution to achieve dynamic attention to different activation level of features. BM provides supplementary information for overlooked regions and enhances the model’s ability to recognize objects as a whole. Additionally, we propose a Cross-Modality Alignment (CA) strategy to better differentiate features of semantically similar classes. It contrasts language descriptions of confusing false positive classes with global image features, yielding more distinctive and robust class representations. Extensive experiments conduct on the VOC12 natural dataset and BCSS medical dataset demonstrate state-of-the-art performance, with 83.90% mIoU on the VOC12 test set and 73.18% mIoU on the BCSS test set.

Histopathological whole-slide images (WSIs) segmentation is essential for precise tissue characterization in medical diagnostics. However, traditional approaches require labor-intensive pixel-level annotations. To this end, we study weakly supervised semantic segmentation (WSSS) which uses patch-level classification labels, reducing annotation efforts significantly. However, the complexity of WSIs and the challenge of sparse classification labels hinder effective dense pixel predictions. Moreover, due to the multi-label nature of WSI, existing approaches of single-label contrastive learning designed for the representation of single-category, neglecting the presence of other relevant categories and thus fail to adapt to WSI tasks. This paper presents a novel multi-label contrastive learning method for WSSS by incorporating class-specific embedding extraction with LLM features guidance. Specifically, we propose to obtain class-specific embeddings by utilizing classifier weights, followed by a dot-product-based attention fusion method that leverages LLM features to enrich their semantics, facilitating contrastive learning between different classes from single image. Besides, we propose a Robust Learning approach that leverages multi-layer features to evaluate the uncertainty of pseudo-labels, thereby mitigating the impact of noisy pseudo-labels on the learning process of segmentation. Extensive experiments have been conducted on two histopathological image segmentation datasets, i.e. LUAD dataset and BCSS dataset, demonstrating the effectiveness of our methods with leading performance.

In this paper, we propose a Dual-path Supplemental Information Learning Architecture (DSILA) for predicting breast cancer Ki-67 status based on T2-weighted (T2w) magnetic resonance imaging (MRI). DSILA consists of two components: 1) a transfer network with multi-scale feature selection strategy to obtain generic multi-scale features most relative to target, 2) a supplemental learning network with a large receptive field and channel-level attention to mine scenario-related semantic information. A regulation item – Aspect Overlap Loss (AOL), is further added to force the supplemental learning network to pay more attention to the regions overlooked by the transfer network. The experimental results tested on the collected T2w MRI breast cancer Ki-67 dataset show that DSILA outperforms state-of-the-art techniques among all adopted evaluation metrics, even achieving 0.85 in Area under the Receiver Operating Characteristic Curve (AUC).

Credit transactions are vital financial activities that yield substantial economic benefits. To further improve lending decisions, stakeholders require accurate and interpretable credit scoring methods. While the majority of previous studies have focused on the relationship between individual features and credit risk, only a few have investigated cross-features. Notably, cross-features can not only represent structured data effectively but also provide richer semantic information than individual features. Nevertheless, most previous methods for learning cross-feature effects from credit data have been implicit and unexplainable. This paper proposes a new credit scoring model based on contrastive augmentation and tree-enhanced embedding mechanisms, termed CATE. The proposed model automatically constructs explainable cross-features by using tree-based models to learn decision rules from the data. Moreover, the importance of each local cross-feature is then derived through an attention mechanism . Finally, the credit score of a user is evaluated using embedding vectors. Experimental results on 4 public datasets demonstrated the interpretability of our proposed method and outperformed 13 state-of-the-art benchmark methods in terms of performance.

Medical image segmentation has long suffered from the problem of expensive labels. Acquiring pixel-level annotations is time-consuming, labor-intensive, and relies on extensive expert knowledge. Bounding box annotations, in contrast, are relatively easy to acquire. Thus, in this paper, we explore to segment images through a novel Dual-path Feature Transfer design with only bounding box annotations. Specifically, a Target-aware Reconstructor is proposed to extract target-related features by reconstructing the pixels within the bounding box through the channel and spatial attention module. Then, a sliding Feature Fusion and Transfer Module (FFTM) fuses the extracted features from Reconstructor and transfers them to guide the Segmentor for segmentation. Finally, we present the Confidence Ranking Loss (CRLoss) which dynamically assigns weights to the loss of each pixel based on the network's confidence. CRLoss mitigates the impact of inaccurate pseudo-labels on performance. Extensive experiments demonstrate that our proposed model achieves state-of-the-art performance on the Medical Segmentation Decathlon (MSD) Brain Tumour and PROMISE12 datasets.

Medical image segmentation methods downsample images for feature extraction and then upsample them to restore resolution for pixel-level predictions. In such schema, upsample technique is vital in restoring information for better performance. However, existing upsample techniques leverage little information from downsampling paths. The local and detailed feature from the shallower layer such as boundary and tissue texture is crucial in segmentation, especially medical image segmentation. To this end, we propose a novel upsample approach for medical image segmentation, Window Attention Upsample (WAU), which upsamples features conditioned on local and detailed features from downsampling path in local windows by introducing attention decoders of Transformer. WAU could serve as a general upsample method and be incorporated into any segmentation model that possesses lateral connections. We first propose the Attention Upsample which consists of Attention Decoder (AD) and bilinear upsample. AD leverages pixel-level attention to model longrange dependency and global information for a better upsample. Bilinear upsample is introduced as the residual connection to complement the upsampled features. Moreover, considering the extensive memory and computation cost of pixel-level attention, we further design a window attention scheme to restrict attention computation in local windows instead of the global range. We evaluate our method (WAU) on classic UNet structure with lateral connections and achieve state-of-the-art performance on Medical Segmentation Decathlon (MSD) Brain and Automatic Cardiac Diagnosis Challenge (ACDC) datasets. We also validate the effectiveness of our method on multiple classic architectures and achieve consistent improvement.

Automatic Medical Image Segmentation (MIS) can assist doctors by reducing labor and providing a unified standard. Nowadays, approaches based on Deep Learning have become mainstream for MIS because of their ability of automatic feature extraction. However, due to the plain network design and targets variety in medical images, the semantic features can hardly be extracted adequately. In this work, we propose a novel Dense Self-Mimic and Channel Grouping based Network (DMCGNet) for MIS for better feature extraction. Specifically, we introduce a Pyramid Target-aware Dense Self Mimic (PTDSM) module, which is capable of exploring deeper and better feature representation with no parameter increase. Then, to utilize features efficiently, an effective Channel Split based Feature Fusion Module (CSFFM) is proposed for feature reuse, which strengthens the adaptation of multi-scale targets by utilizing the channel grouping mechanism. Finally, to train the proposed method adequately, Deep Supervision with Group Ensemble Learning (DSGEL) is equipped to the network. Extensive experiments demonstrate that our proposed model achieves state-of-the-art performance on 4 medical image segmentation datasets.

This paper presents an IPv4/IPv6 communication method in virtual machine environment called Virtual IVI. The purpose is to find an easy way to translate IPv4 service into IPv6 service in datacenter with less hardware change and less applications modification in IPv4 servers. The proposed new mechanism is based on IVI technology which is a stateless IPv4/IPv6 translation technique developed by China Education and Research Network. And the key idea is to migrate IVI hardware to virtual server and modify neutron network system in virtual network in data center. Eventually the mechanism can be applied in our OpenStack environment.