ABSTRACT Prompt tuning‐based few‐shot text classification aims to improve model performance by constructing high‐quality verbalizer. However, existing methods suffer from high subjective bias, insufficient semantic coverage, and uneven representation ability of label words, which limits the further improvements in classification performance. To address these challenges, we propose KPTUltra. The model synergistically integrates multiple pre‐trained models and contrastive learning through class‐sensitive ranking method (CSR) to construct a robust semantic embedding space. Additionally, a genetic algorithm is employed to optimise the mapping between label word and class, enhancing screening stability and semantic matching. Secondly, we introduce a genetic algorithm‐based adaptive label word weight optimization mechanism (GAAWO), which dynamically adjusts both the composition and the weight distribution of label words in the latent space. This enables fine‐grained control and effectively reduces the impact of low‐representative label words. Extensive experiments on multiple few‐shot text classification benchmarks demonstrate that KPTUltra outperforms state‐of‐the‐art baseline methods, achieving superior overall performance.

Significant progress has been made in video restoration under rainy conditions over the past decade, largely propelled by advancements in deep learning. Nevertheless, existing methods that depend on paired data struggle to generalize effectively to real-world scenarios, primarily due to the disparity between synthetic and authentic rain effects. To address these limitations, we propose a dual-branch spatiotemporal state-space model to enhance rain streak removal in video sequences. Specifically, we design spatial and temporal state-space model layers to extract spatial features and incorporate temporal dependencies across frames, respectively. To improve multi-frame feature fusion, we derive a dynamic stacking filter, which adaptively approximates statistical filters for superior pixel-wise feature refinement. Moreover, we develop a median stacking loss to enable semi-supervised learning by generating pseudo-clean patches based on the sparsity prior of rain. To further explore the capacity of deraining models in supporting other vision-based tasks in rainy environments, we introduce a novel real-world benchmark focused on object detection and tracking in rainy conditions. Our method is extensively evaluated across multiple benchmarks containing numerous synthetic and real-world rainy videos, consistently demonstrating its superiority in quantitative metrics, visual quality, efficiency, and its utility for downstream tasks.

The encoder-decoder architecture has been widely adopted by many handwritten mathematical expression recognition (HMER) models. However, these methods may struggle to accurately recognize expressions with complex structures or long sequences due to the lack of global information utilization. To address this issue, we propose a novel network based on the encoder-decoder framework, called the Structure and Counting Aware Network (SCAN), to enable global information awareness and achieve more precise recognition. Specifically, we introduce the Skeleton Shaping and Character Counting Module (SSCCM) to extract the skeleton structure of expressions and the frequency distribution of characters. These two types of information are integrated with the decoder output in the calibration module to refine the predictions. Experimental results demonstrate that SCAN significantly outperforms the existing state-of-the-art (SOTA) models in terms of expression recognition rate (ExpRate) on the CROHME 2014/2016/2019 and HME100K test sets. The code is publicly available at https://github.com/Kerston12138/SCAN.

Images captured at nighttime often face challenges such as low light and blur, primarily caused by dim environments and the frequent use of long exposure. Existing methods either handle the two types of degradations independently or rely on carefully designed priors generated by complex mechanisms, resulting in poor generalization ability and high model complexity. To address these challenges, we propose an end-to-end framework named LIEDNet to efficiently and effectively restore high-quality images on both real-world and synthetic data. Specifically, the introduced LIEDNet consists of three essential components: the Visual State Space Module (VSSM), the Local Feature Module (LFM), and the Dual Gated-Dconv Feedforward Network (DGDFFN). The integration of VSSM and LFM enables the model to capture both global and local features while maintaining low computational overhead. Additionally, the DGDFFN improves image fidelity by extracting multi-scale structural information. Extensive experiments on real-world and synthetic datasets demonstrate the superior performance of LIEDNet in restoring low-light, blurry images. The code is available athttps://github.com/MingyuLiu1/LIEDNethttps://github.com/MingyuLiu1/LIEDNet.

Grayscale image colorization, especially for ethnic costume images, is highly challenging due to its rich and complex color features. The existing image colorization methods usually take the costume image as a whole in practical applications that lead to the ignorance of the semantic information of different parts of the costume. It is known that each part's color distribution of the ethnic costume is different. So, the color mapping of other parts is also diverse, which is determined by distinctive ethnic characteristics. This study introduces fine-grained level semantic information and proposes a high-resolution image colorization model for ethnic costumes targeting enhancement, inspired by semantic-level colorization. The semantic information of different regions of ethnic costumes has a significant impact on the performance of the coloring task. Using Pix2PixHD as the backbone network, we create a new network architecture that maintains color distribution correspondence and spatial consistency of costume images using fine-grained semantic information. In our network, we take the splice result of fine-grained semantic for ethnic costume and grayscale image as the conditions and then feed them into the generative adversarial networks. We also discuss and analyze the influences of the grayscale channel and fine-grained semantics on discriminator. Extensive experiments demonstrate that our method performs well compared with other state-of-the-art automatic colorization methods.

Clothing attribute prediction is a fundamental image classification task in the field of computer vision. Motivated by the human recognition system, we investigate the task relationship and spatial importance where people usually utilize these useful clues to assist in recognizing clothing attributes. In this paper, we propose a novel Holistic Relation Network (HRNet) for clothing attribute recognition, considering the fusion of multiple relations, including spatial and spatial relation via a spatial relation module, spatial and task relation via a task attention module, and task and task relation via a graph context reasoning module. Specifically, we first use the backbone network to extract features from the input image, two types of attention models followed will further learn the features, then the graph context reasoning module will be used to further enhance the features, and finally, a classifier exploited to classify the clothing attributes with the learned representation information. Without using manual image feature filtering methods, this paper aims to achieve clothing attribute recognition by deeply exploring the relationships among different clothing attribute recognition tasks. In this paper, we use double-branches of the attention model to model the relevance of spatial context information and learn more discriminative feature representations from multitask features for clothing attribute prediction. Derived from the prior knowledge learned from the two above-mentioned attention models, we further propose a graph-relation model constructing relationships among different clothing attribute tasks by integrating the spatial association relationships among multitask. The proposed HRNet only uses image-level annotation but it owns a good ability for obtaining distinguishing feature representations. We obtain state-of-the-art performance, which is demonstrated by extensive experiments on three mainstream benchmarks, for example, woman clothing data set, man clothing data set, and shop-domain clothing data set.

Deep learning has achieved remarkable progress for visual recognition on balanced data sets but still performs poorly on real-world long-tailed data distribution. The existing methods mainly decouple the problem into the two-stage decoupling training, that is, representation learning and classifier training, or multistage training based on knowledge distillation, thus resulting in huge training steps and extra computation cost. In this paper, we propose a conceptually simple yet effective One-stage Long-tailed Self-Distillation framework, called OLSD, which simultaneously takes representation learning and classifier training into one-stage training. For representation learning, we take two different sampling distributions and mixup them to input them into two branches, where the collaborative consistency loss is introduced to train network consistency, and we theoretically show that the proposed mixup naturally generates a tail-majority distribution mixup. For classifier training, we introduce balanced self-distillation guided knowledge transfer to improve generalization performance, where we theoretically show that proposed knowledge transfer implicitly minimizes not only cross-entropy but also KL divergence between head-to-tail and tail-to-head. Extensive experiments on long-tailed CIFAR10/100, ImageNet-LT and multilabel long-tailed VOC-LT demonstrate the proposed method's effectiveness.

Due to the high similarity of fine-grained image subclasses, small inter-class changes and large intra-class changes are caused, which leads to the difficulty of fine-grained image classification task. However, existing convolutional neural networks have been unable to effectively solve this problem. Aiming at the above-mentioned fine-grained image classification problem, this paper proposes a multi-scale and multi-level ViT model. First, through data augmentation techniques, the accuracy of fine-grained image classification can be effectively improved. Secondly, the small-scale input and large-scale input of the model make the input image have more feature ex-pressions. The subsequent multi-layeredness effectively utilizes the results of the previous layer of ViT, so that the data of the previous layer can be more effectively used in the next layer of ViT. Finally, cross-attention allows the results of two scale inputs to be fused in a reasonable way. The proposed model is competitive with current mainstream state-of-the-art methods on multiple datasets.

In this article, we present a semantic semisupervised learning (Semantic SSL) approach targeted at unifying two machine-learning paradigms in a mutually beneficial way, where the classical support vector machine (SVM) learns to reveal primitive logic facts from data, while axiomatic fuzzy set (AFS) theory is utilized to exploit semantic knowledge and correct the wrongly perceived facts for improving the machine-learning model. This novel semisupervised method can easily produce interpretable semantic descriptions to outline different categories by forming a fuzzy set with semantic explanations realized on the basis of the AFS theory. Besides, it is known that disagreement-based semisupervised learning (SSL) can be viewed as an excellent schema so that a co-training approach with SVM and the AFS theory can be utilized to improve the resulting learning performance. Furthermore, an evaluation index is used to prune descriptions to deliver promising performance. Compared with other semisupervised approaches, the proposed approach can build a structure to reflect data-distributed information with unlabeled data and labeled data, so that the hidden information embedded in both labeled and unlabeled data can be sufficiently utilized and can potentially be applied to achieve good descriptions of each category. Experimental results demonstrate that this approach can offer a concise, comprehensible, and precise SSL frame, which strikes a balance between the interpretability and the accuracy.

It has very important practical significance to analyze and research minority costume from the perspective of computer vision for minority culture protection and inheritance. As first exploration in minority costume image retrieval, this paper proposed a novel image feature representation method to describe the rich information of minority costume image. Firstly, the color histogram and edge orientation histogram are calculated for divided sub-blocks of minority costume image. Then, the final feature vector for minority costume image is formed by effective fusion of color histogram and edge orientation histogram. Finally, the improved Canberra distance is introduced to measure the similarity between query image and retrieval image. We have evaluated the performances of the proposed algorithm on self-build minority costume image dataset, and the experimental results show that our method can effectively express the integrated feature of minority costume images, including color, texture, shape and spatial information. Compared with some conventional methods, our method has higher and stable retrieval accuracy.