Small Object Detection (SOD) aims to accurately identify and locate small objects in images. However, existing methods usually focus on exploring spatial domain features, neglecting high-frequency features that preserve fine-grained details such as texture and edge information. To overcome this limitation, we propose a High-Frequency Feature-Oriented Network (HFFO-Net). First, we introduce the Channel- wise Frequency Modulation Module (CFMM), which leverages the 2D Discrete Cosine Transform (DCT) to accentuate salient frequency components while mitigating noise interference. Second, we design a High-Frequency Oriented Module (HFOM), which utilizes the Channel Selection Branch (CSB) and Spatial Selection Branch (SSB) to highlight small objects in the channel and spatial region. Third, we introduce a Dual-Query Attention Fusion Mechanism (DQAFM), which reduces the semantic gap between spatial and frequency features and achieves better feature fusion through bidirectional cross-attention. Extensive experiments are implemented, and the corresponding results demonstrate that HFFO-Net excels at detecting small objects.

Few-shot relation extraction aims to identify and classify specific semantic relations between entities from text with a small number of annotated examples. Recent studies have shown that innovative model designs and learning strategies can significantly enhance the model’s generalization ability and performance, even with limited training samples. However, the samples used for training face the dual challenges of scarce annotated data and semantic ambiguity. Given the limitations of the existing SaCon framework in negative sample generation and discrimination efficiency, we propose a dynamic adversarial negative sample enhancement strategy. This strategy introduces adversarial perturbations before encoding the pre-trained language model by constructing a multi-granularity semantic space. Specifically, we first design an entity permutation mechanism to randomly exchange the subject/object entities of sentences in a small batch to generate negative sample clusters with similar semantics but misplaced relations, then, we integrate a multi-view contrastive learning framework to embed adversarial samples into the feature space topology optimization process.To strengthen boundary-sensitive features, an adaptive margin ranking loss function is proposed to dynamically adjust the representation distance constraints of positive and negative samples, forcing the model to capture the deep semantic invariance of relational predicates under limited samples. This method aims to optimize the traditional negative sample random sampling paradigm, actively explore the semantic space through an adversarial generation mechanism, and construct “difficult samples” with minimal semantic deviation through gradient back propagation, thereby improving the model’s ability to parse implicit relational patterns. The experiment result shows that this framework effectively alleviates the risk of overfitting in small sample scenarios by decoupling relational semantics and surface syntactic features, and its dynamic loss design provides mathematical guarantees for orthogonal separation of feature space. Our code is available online at https://github.com/hhy-test/ESCR.

Accurately identifying real anomalies and pseudo-anomalies in complex multi-dimensional time series data has been a difficult problem in time series anomaly detection. To solve this problem, this paper proposes a new framework, STAD, that joint temporal and spatial dimensions. This framework guides the model to capture the correlation information between channels It also aims to learn the deep feature representation of sequences by mining potential information in the spatialtemporal dimension. It can effectively distinguish between true and false anomalies by comparing information from spatial and temporal dimensions. STAD identifies and integrates correlated channels by using a correlation aggregation mechanism to join multiple channels and detect anomalies.In addition, the KAN mixer designed in this paper can effectively extract features from different spatial locations in the spatial-temporal dimension. Through extensive experiments on several public datasets, STAD demonstrates its superiority in terms of accuracy and robustness.

In industrial product inspection, training segmentation models requires a large volume of accurately labeled, high-quality sample data, which is often scarce, leading to the loss of crucial information. Moreover, segmentation models must achieve not only high accuracy but also rapid processing speeds to meet the real-time feedback requirements of production lines. To address these challenges, we propose a novel MFPD method that leverages the super-resolution and style transfer capabilities of diffusion models to enhance image details and generate diverse image styles. This approach improves the segmentation network’s ability to interpret input data while enhancing feature quality and diversity. Furthermore, we design an efficient real-time semantic segmentation network with a streamlined architecture and optimized computational processes, significantly accelerating processing speed. Compared to existing methods, our MFPD approach achieves superior segmentation efficiency and processing speed across multiple datasets, demonstrating its practical advantages in real-world applications.

In the Distantly Supervised Relation Extraction (DSRE) task, it is typically assumed that sentences containing the same entity pair reflect the same relation. While this assumption simplifies the learning process to some extent, it inevitably introduces substantial noise. Previous extensive research has utilized a series of selective attention mechanisms on sentences in the bag to extract relation features, but has seldom considered leveraging the information surrounding the entities and different features. We argue that tokens surrounding the entities play a significant role in relation classification, though their importance varies. In this paper, we propose the Dynamic Semantic Interaction (DSI) module, which uses token-level features to calculate the similarity between the entity and other tokens in the sentence as weights, assigning different importance to each token. Additionally, the Responsiveness Feature Fusion Strategy (RFFS) uses Euclidean distance to calculate reliability scores, adaptively adjusts the information fusion process, and weights different features to reduce the impact of noisy information. Finally, the Relation-Aware Contextual Modeling (RACM) module initializes and trains a set of seed vectors to guide the model in focusing on relation-relevant contextual features, thereby improving relation recognition. Combining these methods, our model is able to better predict the relations between entity pairs. Experimental results show that our model demonstrates significant advantages across various mainstream DSRE datasets.

Unsupervised Continuous Anomaly Detection (UCAD) is gaining attention for effectively addressing the catastrophic forgetting and heavy computational burden issues in traditional Unsupervised Anomaly Detection (UAD). However, existing UCAD approaches that rely solely on visual information are insufficient to capture the manifold of normality in complex scenes, thereby impeding further gains in anomaly detection accuracy. To overcome this limitation, we propose an unsupervised continual anomaly detection framework grounded in multimodal prompting. Specifically, we introduce a Continual Multimodal Prompt Memory Bank (CMPMB) that progressively distills and retains prototypical normal patterns from both visual and textual domains across consecutive tasks, yielding a richer representation of normality. Furthermore, we devise a Defect-Semantic-Guided Adaptive Fusion Mechanism (DSG-AFM) that integrates an Adaptive Normalization Module (ANM) with a Dynamic Fusion Strategy (DFS) to jointly enhance detection accuracy and adversarial robustness. Benchmark experiments on MVTec AD and VisA datasets show that our approach achieves state-of-the-art (SOTA) performance on image-level AUROC and pixel-level AUPR metrics.

The continuous advancement of multimedia technology has led to the exponential accumulation of massive time-stamped data. However, accurately identifying anomalies in such data remains a major challenge. Current anomaly detection methods still face serious limitations, including the difficulty in handling complex time series data and the anomaly masking phenomenon caused by overlapping temporal patterns. Existing methods cannot effectively address these challenges. To overcome these limitations, we propose an unsupervised time series anomaly detection algorithm DMemAD based on a dual-domain memory module. Specifically, we design an STD Mamba structure that can effectively extract trend and seasonal components in the series and enhance the connection between elements in each component through bidirectional learning. Second, we design a dual-domain memory module to avoid anomaly masking by independently storing trend and seasonal patterns. Additionally, we propose a residual-based memory update mechanism to enhance the accuracy of memory updates, ensuring that prototype patterns are stored precisely. Extensive experiments on four datasets from different domains show that DMemAD achieves an average F1 score of 96.81%, outperforming 17 baseline methods and establishing state-of-the-art performance.

In some orthopedic surgeries, the use of three-dimensional (3D) computed tomography (CT) scanning technology is not feasible due to scene limitations, leaving doctors to rely on two-dimensional (2D) X-ray images for real-time diagnosis. However, X-ray images lack 3D information, making accurate diagnosis challenging. Developing an algorithm to convert 2D X-ray images into 3D CT images, while simultaneously combining high-quality 3D reconstruction with precise fracture segmentation, offers a promising solution to the problem. In this study, we propose a novel artificial intelligence (AI)-driven framework named 3D reconstruction and segment anything model (3DRecSAM). The reconstruction image enhancer (RIE) is designed to achieve high-precision 3D reconstruction and provide high-quality feature initialization for fracture segmentation. Meanwhile, the mamba segment anything model (MSAM), based on the segment anything model (SAM) architecture, is developed for accurate fracture segmentation. We introduce a Kolmogorov–Arnold network (KAN)-based attention fusion module (KAF), which facilitates the joint optimization of the RIE reconstruction network and the MSAM segmentation network. Furthermore, the selective scanning mamba with KAN (SKM) is incorporated to enhance feature extraction for both RIE and MSAM. Mamba efficiently captures long-range dependencies and sequential patterns, while KAN’s learnable activation functions facilitate adaptive feature fusion and non-linear representation. To train and evaluate 3DRecSAM, we introduce the real X-ray and CT paired dataset (XCPData), which is publicly available on GitHub: https://github.com/YuanGao1201/XCPData .

Object detection is an essential task in the field of computer vision. The one-stage object detection model directly completes object detection through a single forward propagation and has fast real-time object detection capabilities, making it widely used—especially the model of the You Only Look Once (YOLO) series. Improving the detection accuracy of the YOLO model has always been a research topic. The gradient architecture cascades feature information extraction and aggregates all features at the end, which can improve the feature fusion ability of the network. Combining the idea of gradient architecture, this paper proposes a YOLO based on gradient architecture: Gradient-YOLO. Specifically, this paper integrates gradient architecture into the backbone, neck, and bottleneck structures in the YOLO network, obtaining gradient backbone, gradient neck, and gradient bottleneck, respectively. By combining gradient architecture, various network parts in Gradient-YOLO can fully aggregate multi-layer features, reduce feature loss, and thus improve detection accuracy. This paper takes the mature YOLOv5 model and the latest YOLOv8 model as the baseline and combines gradient thinking to obtain Gradient-YOLOv5 and GradientYOLOv8. Moreover, conduct experimental testing on the MS COCO dataset. Regarding the [email protected] detection indicator, compared to YOLOv5s, Gradient-YOLOv5s increased by 5.07%. Compared to YOLOv8n, Gradient-YOLOv8n has increased by 4.63%. Therefore, the combination of gradient architecture can improve the detection accuracy of YOLO networks.

The field weed detection task under the perspective of Plant Protection UAVs (PPU) is characterized by multi-scale targets and rich background semantic information, which belongs to the target detection task in complex scenarios. Blindly boosting the network size and overusing the attention mechanism in such tasks are not effective in improving the model accuracy. The core of the problem lies in the fact that the covariate features of the target are shifted during the transfer of the three layers of image semantic information (visual, object and conceptual layers). This phenomenon is particularly evident at the conceptual level, resulting in models that do not accurately understand the target information. Redundant semantic information and irrational attention mechanisms for complex scenarios are the cause of the problem. In this paper, we propose the Color and Feature Space Classification (CFSC) method, which aims to construct a covariate semantic information matrix that spans the visual, object and conceptual layers. Mitigating the problem of offsetting semantic information of covariate features in complex scenarios. The color and feature space classification method is applied to a one-stage detection model, YOLOv8, and experiments are conducted on three complex scene PPU weed datasets. The experimental results show that the CFSC method can improve the model accuracy, loss computation capability and accelerate the gradient descent.

Deep learning technology has been widely applied in industrial quality inspection tasks to improve the accuracy of defect detection, object recognition, and classification. However, in the task of object detection, both feature-based and regression-based traditional knowledge distillation methods impose overly strict constraints on the student model. To address the above issues, this article proposes Global Fusion and Feature Restoration Knowledge Distillation(FRD). FRD integrates contextual information into the channel through a Global Fusion Module (GFM), and further utilizes attention mechanisms to adaptively focus on the distillation region after separating the foreground background. FRD also uses a Mask Feature Restoration (MFR) to mask and restore a portion of student features, improving the learnability of the model. At the same time, FRD adopts a comprehensive approach of multiple loss superposition constraints, rather than simply using MSE losses to imitate the features of teachers. Experiments have shown that FRD can effectively improve model performance in industrial defect detection tasks. On the aluminum surface defect dataset, FRD increased the mAP index of RetinaNet-Res50 from 57.7% to 61.7%. We also confirmed the effectiveness of FRD for general object detection on the Coco dataset. On a randomly selected COCO dataset containing 4000 images, FRD increased the mAP metric of RetinaNet-Res50 from 21.5% to 43.6%.

Image anomaly detection usually relies on a large set of training samples and abnormal samples are relatively rare and challenging to obtain in daily industrial scenarios. In the scenario of Few-Shot Anomaly Detection (FSAD), how to better utilize the fine-grained features of the few images is a key issue. To solve these problems, a Finer-Grained Siamese Network (FGSNet) is proposed in this paper. FGSNet considers the setting of Few-Shot Anomaly Detection (FSAD) and consists of two stages. The first stage is responsible for extracting finer-grained features and roughly aligning the image features, while incorporating an efficient Fine-grained Feature Fusion Module$(\mathbf{F}^{3}\mathbf{M})$to enhance feature representation. Meanwhile, we design a Deep-supervised Loss to improve the level of fine-grained information extraction. The second is primarily used to refine and denoise the fused features, followed by detailed alignment operations for subsequent feature distribution modeling. Compared to most existing FASD models that use single-class training and single-model evaluation, FGSNet is more suitable for existing industrial scenarios. Extensive experiments are conducted on the publicly available MVTec AD and MPDD datasets in this paper. The results show that, for 2, 4 and 8-shot cases, FGSNet can increase the average Image-AUROC on MVTec AD by 0.87%, 1.27% and 1.33% respectively, compared to RegAD.

In industrial manufacturing, visual anomaly detection is critical for maintaining product quality by detecting and preventing production anomalies. Anomaly detection methods based on knowledge distillation demonstrate promising performance in addressing the unpredictability and diversity of anomalies. However, they suffer from a lack of effective guidance from anomaly-free priors when handling anomalous features and underutilize multi-scale features during the segmentation scoring stage, yielding suboptimal detection results. To alleviate these issues, we propose an Anomaly-free Prior Guided knowledge distillation (APG) for industrial anomaly detection. Firstly, it filters the abnormal features by training the de-noising target network with knowledge distillation structure. Concurrently, we propose the Prior Perception Propagation Module (P3M), which extracts more efficient anomaly-free features by imposing constraints on anomalous features. Secondly, we propose the Multi-scale Prior Guided Fusion Module (MPGFM) to improve anomaly detection accuracy by utilizing anomaly-free features from the target network as priors to guide the generation and fusion of cross-scale differential features. Finally, the Global Perception Enhancement Module (GPEM) is proposed to construct an anomaly scoring network, leveraging comprehensive scene features to enhance the detection and localization performance of numerous small-target anomalies in industrial manufacturing. Extensive experiments on the MVTecAD and BTAD datasets show that the proposed method demonstrates a consistent and significant outperformance against competing methods.

In the field of industrial production, anomaly detection is crucial for ensuring product quality and maintaining production efficiency. With the continuous advancement of computer vision technology, it has shown tremendous potential in industrial applications. However, the scarcity of labeled anomaly samples in real-world operating environments poses significant challenges for traditional anomaly detection techniques. To address this, we propose MemADet, a novel anomaly detection model that employs an unsupervised approach and leverages a representative memory bank. It employs a dynamic decision mechanism to control the representativeness of the features stored in the memory bank, and employs a weighted anomaly score calculation mechanism to further enhance the performance of image anomaly detection. Our evaluations indicate that MemADet performs robustly in industrial image anomaly detection across three datasets, with particularly no-table detection accuracy on the MVTec AD dataset. Its efficacy is further validated by competitive results on two additional datasets, highlighting its consistent and effective performance in various settings.

Applications in Engineering: In industry, surface defect detection is crucial for improving product quality . However, there are many challenges in industrial inspection scenarios, such as interference from background noise, complex small-target problems, significant variations in target objects, and the problem of finding a balance between inspection speed and accuracy. To address the above problems, this paper proposes an industrial defect-aware network based on cross-layer semantic information guidance and contextual attention enhancement (IDP-Net). Specifically, IDP-Net has four different new features. The contribution of artificial intelligence : Firstly, to solve the industrial surface context and defect similarity problem, this paper proposes a Lightweight Local Global Feature Extraction Network (LLG-Net), unlike other methods, the effective combination of self-attention blocks and convolution blocks ensures gradual integration of global and local features across multiple layers, to improve the detection ability of targets with significant changes in scale, this paper designs a Multiscale Perceptual Feature Aggregation Network (MPA-Net), adequately fuses the shallow fine-grained information and the deep semantic information. Then, to enhance the connection between multi-scale semantic information, an adaptive cross-layer feature fusion module (ACFF) is proposed, which is novel in integrating the characteristics of multiple adjacent levels to help the model better capture the different scale characterisation of the target. Finally, a Region Attention Module (RAM) is proposed and introduced in the detector to enhance the attention to the critical regions around the target object. In particular, this paper proposes a new localisation loss function (MEIoU) that enhances the network’s attention to objects at different scales. The experimental results show that 94.3%, 98.7% and 99.5% of [email protected] are obtained on steel, PCB and aluminium surface defect datasets, respectively, and 50 FPS is achieved, which is better than the current mainstream detectors and meets the demand of practical industrial production.

With the rapid development of industrial automation, large-scale production of automated pipelines has become a trend. In the production process of industrial products, the quality detection of industrial products is an essential means to avoid economic losses and ensure personal safety. Improving industrial product quality detection accuracy and speed has been an important research topic in this field. In recent years, one-stage and two-stage deep learning object detection methods have been applied in defect detection. However, problems such as significant changes in object scale, high similarity, and the balance of speed and accuracy in industrial detection scenarios result in poor performance of common object detection algorithms. To address these issues, this paper proposes a Glass Bottle Bottom Mold Sequence Recognition Data Set and designs a novel dual collaborative paths feature network (DCP- Net) for industrial defect detection. The DCP-Net is designed to extract object features with varied scales from two branches, which can effectively focus on multi-scale industrial product defect features. Moreover, this paper presents the feature filter to obtain fine-grained information about objects, significantly improving similar objects' classification. In the experiments of the open data set of steel defects and the point sequence data set of glass bottle bottom mold collected in this paper, this method achieves higher accuracy than other methods.

The detection of defects in printed circuit boards requires high accuracy and realtime performance. Existing industrial detection models generally adopt a pure convolutional structure for ease of deployment. However, the detection accuracy of these models is often insufficient to meet the requirements of the scene. To improve the detection model accuracy and ease of deployment, this paper proposes a convolutional merging Transformer network(CMTRNet). The CMTR-Net model proposes a backbone network (CNN-Former) that uses convolutional modules to replace self-attention, combining the Transformer architecture with a convolutional structure. This approach not only avoids the drawback of self-attention high computation complexity that is detrimental to deployment but also improves the model detection accuracy. Based on CNN-Former, this paper also proposes a feature fusion module that can better fuse the features extracted by CNN-Former. Further-more, based on the CMTRNet model and the characteristics of circuit board defects, this paper proposes a loss function called Melt-IoU, which can make the initial training phase smoother and further improve detection accuracy. Experiments have shown that CMTRNet outperforms existing advanced models on both datasets.