Lane detection methods based on anchors have received increasing attention, but fixed-shape anchors make it difficult to model complex lane line shapes. To solve this problem, we propose an Enhanced Curve Perception Network (ECPNet). Specifically, we propose a Layer-by-layer Context Fusion (LCF) module to fully utilize both high-level and low-level features in lane detection by establishing short hop connections across feature layers of diverse scales. Then, we propose a novel Structural Correction Prediction (SCP) module, which enhances the detection ability of the model on the curve structure lane by dynamically guiding the selection of anchor classification patterns. In addition, ECPNet adaptive calibration pays attention to channel features through the Cross-Channel Attention (CCA) mechanism. Experiments on the two most representative datasets demonstrate that the proposed method achieves state-of-the-art performance in a variety of environments, especially in curvy lanes.

Unmanned Aerial Vehicle (UAV) image target detection holds significant value for a wide range of applications in modern society. However, due to the variable flight altitude of UAV, the captured images often exhibit significant differences at the target scale and contain a large number of small targets. The existing methods are difficult to adapt to these changes, resulting in a decrease in detection accuracy. To address this issue, this paper proposes a new method for UAV image object detection based on full scale feature aggregation and grouped feature reconstruction FFAGRNet. Firstly, existing feature fusion methods are hindered by the layer-by-layer transfer structure, which limits effective information exchange between feature maps of different scales. In response, we propose the Full-scale Feature Aggregation module (FFA), which performs scale adaptation and information aggregation across multiple sets of feature maps, producing high-quality aggregated feature maps. Secondly, to further refine aggregation features and eliminate redundancy, we introduce the Grouping Feature Reconstruction module (GFR). This module subdivides aggregation features into multiple sub-level features, allowing them to autonomously learn channel and spatial layouts of target features. Lastly, we present the Parallel Super-resolution Semantic Enhancement module (PSSE) to reconstruct deep feature maps and incorporate spatial contextual information, effectively increasing the proportion of semantic information and enhancing the model’s ability to classify ambiguous targets. To validate the effectiveness of our proposed method, extensive experiments were conducted on the VisDrone2021 and UAVDT datasets. The results demonstrate that compared to the baseline, our method achieves a significant improvement in mAP50, with increases of 7.6% and 4.6% respectively, showcasing excellent performance compared to existing methods.

Recently, video saliency prediction has attracted increasing attention, yet the improvement of its accuracy is still subject to the insufficient use of multi-scale spatiotemporal features. To address this issue, we propose a 3D convolutional Multi-scale Spatiotemporal Feature Fusion Network (MSFFNet) to achieve the full utilization of spatiotemporal features. Specifically, we propose a Bi-directional Temporal-Spatial Feature Pyramid (BiTSFP), the first application of bi-directional fusion architectures in this field, which adds the flow of shallow location information on the basis of the previous flow of deep semantic information. Then, different from simple addition and concatenation, we design an Attention-Guided Fusion (AGF) mechanism that can adaptively learn the fusion weights of adjacent features to integrate them appropriately. Moreover, a Framewise Attention (FA) module is introduced to selectively emphasize the useful frames, augmenting the multi-scale temporal features to be fused. Our model is simple but effective, and it can run in real-time. Experimental results on the DHF1K, Hollywood-2, and UCF-sports datasets demonstrate that the proposed MSFF-Net outperforms existing state-of-the-art methods in accuracy.

Current video saliency prediction methods have made great progress relying on the feature extraction capability of CNN, but there are still many defects in hierarchical feature fusion, limiting the further improvement of accuracy. To address this issue, we propose a 3D convolutional Hierarchical Spatiotemporal Feature Fusion Network (HSFF-Net). Specifically, we propose a Bi-directional Temporal-Spatial Feature Pyramid (BiTSFP), the first application of bi-directional fusion architectures in this field, which adds the flow of shallow location information on the flow of deep semantic information. Then, different from addition and concatenation, we design a Hierarchical Adaptive Fusion (HAF) mechanism that can adaptively learn the fusion weights of adjacent features. Moreover, a Frame-wise Attention (FA) module is introduced to augment the temporal features to be fused. Our model is simple yet effective and can run in real-time. Experimental results on the three video saliency benchmarks demonstrate that the HSFF-Net outperforms existing state-of-the-art methods in accuracy.

Object detection on UAV images is a recent research hotspot. Existing object detection methods have achieved good results on general scenes, but there are inherent challenges with UAV images. The detection accuracy of UAV images is limited by complex backgrounds, significant scale differences, and densely arranged small objects. To solve these problems, we propose a UAV image object detection network based on Self-attention Guidance and Multi-scale Feature fusion (SGMFNet). Firstly, we design a Global-Local Feature Guidance module (GLFG). This module can effectively combine local information and global information, which makes the model focus on the object area and reduces the impact of complex background. Secondly, an improved Parallel Sampling Feature Fusion module (PSFF) is designed to efficiently fuse multi-scale features. Thirdly, we design an Inverse-residual Feature Enhancement module (IFE), which is embedded in the front of the newly added detection head to enhance feature extraction on small objects. Finally, we conduct a large number of experiments on the VisDrone2019 dataset. The results show that the proposed SGMFNet outperforms other popular methods, and has achieved good results in many scenarios.

High-precision remote sensing image object detection has broad application prospects in military defense, disaster emergency, urban planning, and other fields. However, the arbitrary orientation, dense arrangement, and small size of objects in remote sensing images lead to poor detection accuracy of existing methods. To achieve accurate detection, this paper proposes an arbitrary directional remote sensing object detection method, called FANet, based on feature fusion and angle classification. Initially, the angle prediction branch is introduced, and the circular smooth label method is used to transform the angle regression problem into a classification problem, which solves the difficult problem of abrupt changes in the boundaries of the rotating frame while realizing the object frame rotation. Subsequently, to extract robust remote sensing objects, innovative introduce pure convolutional model as a backbone network, while Conv is replaced by GSConv to reduce the number of parameters in the model along with ensuring detection accuracy. Finally, the strengthen connection feature pyramid network (SC-FPN) is proposed to redesign the lateral connection part for deep and shallow layer feature fusion, and add jump connections between the input and output of the same level feature map to enrich the feature semantic information. In addition, add a variable parameter to the original localization loss function to satisfy the bounding box regression accuracy under different IoU thresholds, and thus obtain more accurate object detection. The comprehensive experimental results on two public datasets for rotated object detection DOTA and HRSC2016 demonstrate the effectiveness of our method.

With the rapid development of the unmanned aerial vehicle (UAV) industry, UAV image object detection technology has become a hotspot. However, due to a large number of dense small objects in UAV images, quickly and effectively detecting objects and achieving accurate classification is still a challenge. With this observation, we propose an efficient object detection network for UAV images based on cross-layer feature aggregation (CFANet). Firstly, we design a novel cross-feature aggregation module (CFA) to aggregate features at different scales on the basis of avoiding semantic gaps, so as to replace common features for feature fusion and achieve accurate detection. This method makes up for the defect that the layer-by-layer feature transfer method only focuses on the features of the previous layer and cannot fully integrate spatial and semantic information. Secondly, a layered associative spatial pyramid pooling module (LASPP) is proposed to capture context information while maintaining the sensitivity of feature maps at different layers to detail information. Thirdly, the alpha-IoU loss function is introduced to accelerate the convergence speed of the model and improve the detection accuracy. Finally, an adaptive overlapping slice (AOS) for high-resolution images is proposed to protect the integrity of the object when slicing. To verify the effectiveness of the proposed method, extensive experiments on challenge datasets for object detection in UAV images VisDrone2021 and UAVDT datasets are carried out. The results show that, compared with the other most advanced detectors, the proposed method can achieve significant performance on the basis of ensuring real-time detection.