Unmanned aerial vehicles (UAVs) with thermal imaging cameras are widely used for target tracking, reconnaissance, and search operations. However, rapid thermal camera rotations during field-of-view adjustments introduce significant motion blur, impairing real-time image detection and tracking. While deep learning has been a dominant approach for image deblurring, its application to infrared image motion deblurring (IRMD) remains limited owing to the lack of publicly available datasets and challenges in handling large motion blur or maintaining real-time performance. This study addresses these gaps by constructing a large-scale UAV infrared motion deblurring (U2IRD) benchmark dataset, incorporating gyroscopic steering rate information. Additionally, we propose a gyro-aided spatial frequency network (GSFNet) that uses spatial and frequency domain features for UAV IRMD. The input data converts the gimbal steering rate information into a pixel distribution intensity map as a priori information. Specifically, the designed spatial depth residual attention module captures critical spatial domain details, while the multiple frequency domain feature recovery module extracts frequency domain features for effective deblurring. Extensive evaluations on U2IRD and synthetic thermal blurred image datasets demonstrate that the proposed method achieves state-of-the-art deblurring performance. The new IRMD dataset, available at https://github.com/aurora-sea/U2IRD, is anticipated to facilitate advancements in UAV IRMD research and applications.

The detection of small infrared targets with a low signal-to-noise ratio and low contrast in high-noise backgrounds is challenging due to the lack of spatial features of the targets and the scarcity of real-world datasets. Most existing methods are based on single-frame images, which are prone to numerous false alarms and missed detections. This paper proposes ST-Trans that provides an efficient end-to-end solution for the detection of small infrared targets in the complex context of sequential images. First, the detection of small infrared targets in complex backgrounds relying only on a single image has been significantly difficult due to the lack of available spatial features. The temporal and motion information of the sequence image was found to effectively improve target detection performance. Therefore, we used the C2FDark backbone to learn the spatial features associated with small targets, and the spatial-temporal transformer module to learn the spatiotemporal dependencies between successive frames of small infrared targets. This improved the detection performance in challenging scenes. Second, due to the lack of publicly available infrared small target sequence datasets for training, we annotated a set of small infrared targets for challenging scenes and published them as the sequential infrared small target detection (SIRSTD) dataset. Finally, we performed extensive ablation experiments on the SIRSTD dataset and compared its performance with that of state-of-the-art methods to demonstrate the superiority of the proposed method. The results revealed that ST-Trans outperformed other models and can effectively improve the detection performance for small infrared targets. The SIRSTD dataset is available at https://github.com/aurora-sea/SIRSTD.

The detection of small infrared targets with a low signal-to-noise ratios and contrasts in noisy and cluttered backgrounds is challenging and therefore a domain of active research. Traditional methods result in a large number of false alarms and missed detections. In the case of convolutional neural network-based methods, it may not be possible to identify deep small targets, or the details of the target’s edge contours may not be appropriately considered. Therefore, this paper proposes MSAFFNet to perform infrared small target detection based on an encoder-decoder framework. In the encoder stage, small target features are extracted using a resnet-20 backbone network, and the global contextual features of small targets are extracted using an atrous spatial pyramid pooling module. In the decoding stage, a dual-attention module is used to selectively enhance the spatial details of the target at the shallow level and representative features of the semantic information at the deep level. Multi-scale feature maps are then concatenated to achieve superior feature fusion. Additionally, multi-scale labels are constructed to focus on the details of the target contour and internal features based on edge information and an internal feature aggregation module. Experiments conducted on the NUAA-SIRST, NUDT-SIRST and XDU-SIRST datasets revealed that the proposed approach outperforms the representative methods and achieves an improved detection performance.

Infrared (IR) ship tracking is becoming increasingly important in various applications. However, it remains a challenging task as the information that can be obtained from infrared images is limited. Aiming at enhancing IR ship tracking accuracy, we propose an innovative approach by presenting feature integration module (FIM) and backup matching module (BMM). FIM takes appearance feature, complete intersection over union (CIoU), and motion direction metrics into account. Regarding appearance feature extraction, an end-to-end characteristic learning strategy with a cross-guided multi-granularity fusion network is proposed to obtain more integral appearance features and enhance re-identification accuracy, which helps to distinguish individual IR ship targets better. Besides, a backup matching strategy is then used to match the unmatched tracks and detections after cascaded matching. Virtual trajectories are generated for the matched tracks to optimize parameters by parameter optimization module (POM). The accumulation of errors caused by the lack of observations in the Kalman filter is reduced. Thus, the position of IR ships can be estimated more accurately, and more robust IR ship tracking can be achieved. In addition, we present a sequential frame IR ship tracking dataset, providing the first public benchmark for testing IR ship tracking performance. Experimental results indicate that the MOTA, MOTP and IDs of the proposed method are 73.441, 80.826, and 32, respectively, outperforming other state-of-the-art methods. This demonstrates the superior robustness of the proposed method, particularly when the IR ships are occluded or the target texture information is lacking. Our dataset is available at https://github.com/echo-sky/SFIST.

The inability of conventional algorithms to detect infrared (IR) ship targets in complex scenes led to the development of detection methods based on convolutional neural networks (CNNs). In this study, we propose a CNN-based stacked residual coordinate attention network (SRCANet) for detecting IR ship targets. Three-directional stacked interaction modules and a full-scale skip connection feature fusion scheme are introduced. The proposed network maintains and integrates sufficient contextual information of IR ship targets and obtains clear target boundary information. A cascaded residual coordinate attention module (CRCAM) is designed as the basic node in the SRCANet. Additionally, a residual coordinate attention module (RCAM) is introduced, which combines a two-dimensional convolution layer with batch normalisation and rectified linear unit (CBR), a coordination attention module, and a residual connection. The RCAM enhances the input feature map and improves the representability of objects of interest. The CRCAM comprises several cascading RCAMs that deepen the feature extraction layers. Furthermore, because there is no publicly available IR ship target dataset for segmentation, pixel-level annotations are performed on a set of IR ship target images and released as a single-frame IR ship detection (SISD) dataset. Extensive experiments were conducted on the SISD dataset and the widely used single-frame IR small target dataset to demonstrate the superiority of the proposed method. The results indicate that the SRCANet outperforms the state-of-the-art models, and it is more robust when target texture information is lacking. The SISD dataset is available at https://github.com/echo-sky/SISD.