Transformer-based methods excel in remote sensing image super-resolution (RSISR) due to their ability to capture abundant self-similarity textures and structural information, which are critical for restoring high-resolution details. However, the core component of these methods, the self-attention mechanism, requires substantial computational resources, resulting in a restriction of deployment on resource-constrained remote sensing devices. The redundant feature extraction and insufficient refinement of local features also cause the significant RSISR performance drop in multi-degradation scenarios where RSI often suffers from optical blur and transmission noise caused by adverse imaging environments. To mitigate the above limitations, we present a Lightweight Criss-Cross Swin Transformer (CCST) for Blind Remote Sensing Image Super-Resolution. Concretely, we introduce criss-cross encoding into the self-attention mechanism to establish criss-cross feature correlations of each pixel in an RSI. Along with the shifted window mechanism, repeated criss-cross encoding indirectly builds global feature dependencies. Compared to the conventional self-attention mechanism that spans the entire window, the proposed criss-cross self-attention mechanism drastically reduces computational overhead and feature redundancy while capturing more global information by using large-size windows. Furthermore, to enhance the ability of the RSISR model to extract local features while expanding its receptive field, we incorporate a gated feed-forward tiny network to integrate multi-scale features and introduce gated coefficient learning to adaptively filter redundant counterparts. Experimental results show that our CCST achieves superior performance with lower computational demand compared to state-of-the-art Transformer-based SR algorithms and traditional RSISR methods in multi-degradation scenarios.

Existing ac/dc power flow computations necessitate sequential convergence-oriented trial-and-error under various dc control modes, rising computational burden. This article thus proposes a physics-guided multiagent graph learning (PG-MAGL) method toward real-time power flow analysis with dc control mode adaptation. The tailored graph structure with built-in dc control modes and state variables is first advanced to ensure topology adaptability. Then, MAGL is proposed to enable adaptive jump over dc control modes. The trick is to organize multiagents to parameterize power flow solutions under various dc control modes and set aside trigger signals according to the operational violations of converters for the agent switching to the follow-up agent. To clarify the trigger signals, an augmented Lagrangian method-based PG-MAGL method is finally designed. It relaxes the control boundaries into the violation minimizers and enforces other constraints, such that dc control switching can be identified by the only violation signal. Utilizing inductive biases to rectify experiential biases in pure data-driven models, PG-MAGL enables precise inference of dc control mode feasibility. Case study shows that, relative to the other seven data-driven rivals, only the proposed method matches the performance of the model-based baseline, also beats it in efficiency beyond ten times.

Larger-scale stochastic power systems urge the development of real-time alternating current optimal power flow, artificial intelligence (AI) thus becomes an alternative. However, traditional AI only imitates experiences, and cannot follow in-depth physics. This may cause an undesired nongeneralizability and topology intractability. To address this issue, a physics-guided graph neutral network (PG-GNN) is proposed. The PG-GNN firstly capture the physical constraints by a dual Lagrangian. Besides, the branch features of power grids are fully exploited to allow the PG-GNN to master tremendous topological patterns. To further manage the out-of-distribution topology, stability property of the PG-GNN is proved, then upon this evidence, an online transfer learning is proposed to allow the PG-GNN to fast master the unexpected topology. Numerical tests on benchmarks show that, the proposed method holds well topology-transferability, enables near or even better solutions than conventional optimizer, but merits much more than 100 times efficiency.

Reference-based super-resolution (RefSR), which aims to introduce an additional high-resolution (HR) reference (Ref) image to improve the reconstruction performance of low-resolution (LR) image, has achieved great success. Existing RefSR methods rely on the texture information of the reference image to compensate for the missing information. However, the differences of scale and orientation are unavoidable when obtaining useful information from the Ref image. In addition, it is difficult to achieve a good match due to the ill-posed between the LR image and Ref image. To address these challenges, we propose a new matching module, named progressive spatial adaptation module (PSAM). PSAM is a progressive alignment model to effectively overcome the ill-pose between the LR image and the Ref image. Further, we propose a spatial correction module (SCM) to correct for scale and orientation. Meanwhile, we introduce a gradient map to further correct the matched features. In addition, we propose a new loss function MC-Loss to ensure the success of correction. Experiments show that the matching method using PSAM to directly replace the existing RefSR is significantly better than the original matching method in terms of both quantitative and qualitative results.

Deep learning (DL)-based multisource information processing plays an essential role in the Internet of Medical Things (IoMT). In this field, medical image fusion integrates scan results from different devices, supporting healthcare systems to make a more informed diagnosis. This study proposes a DL-based network to fuse multimodal medical images. In our method, the lattice unit (LU) is designed to improve the representation capability of the fusion network. Moreover, to acquire hierarchical features from images, the progressive module (PM) treats the network’s shallow and deep layers differently. The shallow layers represent the structure of the source image; the deep layers correspond to details. Different loss functions are utilized for these two kinds of information to retain fused images’ salient structures and functional information. Experiments show that the proposed algorithm performs well on visual quality and objective evaluation, which provides a reliable reference for medical diagnosis. In addition, this method is lightweight and speedy compared to existing algorithms, facilitating further placement in the IoMT’s specific devices.

In this article, we focus on the issue of adaptive fuzzy finite-time tracking control for a class of uncertain fractional-order nonlinear systems with external disturbance. A new finite-time fractional-order command filtered implementation scheme is presented for the adaptive backstepping method. In the command filtered implementation approach, analytical computation of the fractional derivatives of the stabilizing functions is not necessary. Therefore, the controller and adaptive law of the systems are easier to derive and implement. Based on the proposed command filter, adaptive backstepping technique, and fractional Lyapunov’s direct method, a novel adaptive fuzzy finite-time controller is designed, which can guarantee that the tracking error converges to a small neighborhood of the origin in finite time, and other signals of the closed-loop systems are semiglobal uniform ultimate bounded. In the design process of the controller, fuzzy logic systems (FLSs) are employed to approximate the unknown nonlinear functions, and an auxiliary function is adopted to compensate for the unknown external disturbance and approximation errors of FLSs. Finally, a simulation example is given to show the effectiveness and availability of the proposed control strategy.

Structured light 3D imaging is often used for obtaining accurate 3D information via phase retrieval. Single-pattern structured light 3D imaging is much faster than multi-pattern versions. Current phase retrieval methods for single-pattern structured light 3D imaging are however not accurate enough. Besides, the projector resolution in a structured light 3D imaging system is expensive to improve due to hardware costs. To address the issues of low accuracy and low resolution of single-pattern structured light 3D imaging, this work proposes a super-resolution phase retrieval network (SRPRNet). Specifically, a phase-shifting module is proposed to extract multi-scale features with different phase shifts, and a refinement and super-resolution module is proposed to obtain refined and super-resolution phase components. After phase demodulation and unwrapping, high-resolution absolute phase is obtained. A sine shifting loss and a cosine shifting loss are also introduced to form the regularization term of the loss function. As far as can be ascertained, the proposed SRPRNet is the first network for super-resolution phase retrieval by using a single pattern, and it can also be used for standard-resolution phase retrieval. Experimental results on three datasets show that SRPRNet achieves state-of-the-art performance on $1\times $ , $2\times $ , and $4\times $ super-resolution phase retrieval tasks.

Structured light illumination is a 3D scanning technique based on projecting a series of striped patterns and reconstructing depth based on the observed warping of the pattern across the target surface. Extensively studied, real-time performance is of paramount importance in many applications. In this Letter, we build on prior researches with epipolar geometry to further simplify the computations of 3D point clouds, with the symmetrical epipolar features derived by extending epipolar geometry over normalized calibration matrices of the camera and projector. Experiments show that the proposed two new processes are of the same accuracy over the normalized calibration matrices with substantially fewer calculations.

To efficiently reconstruct magnetic resonance images (MRI) from highly undersampled measurements by using compressed sensing (CS), in this letter, we propose a hybrid regularization model from deep prior and low-rank prior. The local deep prior is explored by a fast flexible denoising convolutional neural network (FFDNet). To compensate for 1) the generalization capability of FFDNet on artifact noise caused by undersampling K-space and 2) the inaccurate noise estimation for various undersampling ratios, we model the low-rank prior as a weighted Schatten p-norm to obtain the global information of MRIs. The final model, combined by the local deep and low-rank priors, is solved by the alternating directional method of multipliers under the plug-and-play framework. Compared with the popular CS-MRI approaches, the experimental results demonstrate that the proposed method can achieve better reconstruction performance in terms of quality index and visual effects.

Summary Human behavior would lead to a significant impact on the environment. By monitoring the environment, we can indirectly monitor human behavior. Remote sensing (RS) technology provides a large number of multispectral (MS) images. When combining the Internet of things (IoT) technology, those images can be used for human behavioral monitoring. However, due to the limitation of the optical sensors embedded in satellites, the spatial resolution of MS image is relatively low, which poses a huge problem for further understanding these images. Pansharpening, also known as multisensor image fusion, aims to sharp an MS image to a high‐resolution multisensor image (HMS) by integrating a corresponding high‐resolution panchromatic (PAN) image. By doing so, the redundancy among big data can be effectively reduced. Traditional Intensity‐Hue‐Saturation (IHS)–based methods often suffer from spectral distortion. To address this problem, a novel pansharpening method is proposed in this paper. Different from those traditional IHS methods, the proposed method first decomposes MS and PAN into high‐frequency‐component (HFC) and low‐frequency‐component (LFC), respectively. Then, the guided filter (GF) is utilized to enhance the spectral information on the detail map. Furthermore, the detail map is refined according to the adaptive coefficients for each band of MS. By performing experiments, we demonstrate the proposed method can obtain satisfying results in both visual quality and object assessment among existing methods.

Abstract Imaging systems with different imaging sensors are widely applied to surveillance field, military field, and medicine field. Particularly, infrared imaging sensors can acquire thermal radiations emitted by different objects but lack textural details, and visible imaging sensors can capture abundant textural information but suffer from loss of scene information under poor weather conditions. The fusion of infrared and visible images can synthesize a new image with complementary information of the source images. In this paper, we present a deep learning method with encoder–decoder architecture for infrared and visible image fusion. Firstly, multiscale channel attention blocks are introduced to extract features at different scales, which can preserve more meaningful information and enhance the important information. Secondly, we utilize the improved fusion strategy based on visual saliency to fuse feature maps. Lastly, the fusion result is restored via reconstruction network. In comparison with other state‐of‐the‐art approaches, our experimental results achieve appealing performance on visual effects and objective assessments.

Recently, Industry 4.0 has attracted much attention. It has close relations with the Internet of Things (IoT). On the other hand, convolutional neural networks (CNNs) have shown promising performance in many foundational services of the IoT applications. For the IoT applications with high-speed data streams and the requirement of time-sensitive actions, fast processing is demanded on small-scale platforms or even on IoT devices themselves. Therefore, it is inappropriate to employ cumbersome CNNs in IoT applications, making the study of model compression necessary. In knowledge transfer, it is common to employ a deep, well-trained network, called teacher, to guide a shallow, untrained network, called student, to have better performance. Previous works have made many attempts to transfer single-scale knowledge from teacher to student, leading to degradation of generalization ability. In this article, we introduce multiscale representations to knowledge transfer, which facilitates the generalization ability of student. We divide student and teacher into several stages. Student learns from multiscale knowledge provided by teacher at the end of each stage. Extensive experiments demonstrate the effectiveness of our proposed method both on image classification and on single image super-resolution. The huge performance gap between student and teacher is significantly narrowed down by our proposed method, making student suitable for IoT applications.

Multisensor image fusion or pansharpening aims to sharpen a multispectral (MS) image by integrating the detail map derived from a panchromatic (Pan) image. The intensity-hue-saturation (IHS)-based methods are well adopted in pansharpening applications. However, the pansharpened MS images by IHS-based methods usually suffer from serious spectral distortions and local artifacts due to the mismatch between the estimated detail map and its ground truth. To overcome these defects, we propose a weighted least squares (WLS)-filter-based method in this letter. Different from existing IHS-based methods, the proposed method eliminates the influence of the low-frequency components of the Pan and MS images with the WLS filter. Moreover, the derived detail map is further refined based on the spectral signatures for different bands of the MS image. We test the proposed method on various satellites data; the experimental results demonstrate that the proposed method performs well in both spectral and spatial qualities.

Active stereo vision is a method of 3D surface scanning involving the projecting and capturing of a series of light patterns where depth is derived from correspondences between the observed and projected patterns. In contrast, passive stereo vision reveals depth through correspondences between textured images from two or more cameras. By employing a projector, active stereo vision systems find correspondences between two or more cameras, without ambiguity, independent of object texture. In this paper, we present a hybrid 3D reconstruction framework that supplements projected pattern correspondence matching with texture information. The proposed scheme consists of using projected pattern data to derive initial correspondences across cameras and then using texture data to eliminate ambiguities. Pattern modulation data are then used to estimate error models from which Kullback-Leibler divergence refinement is applied to reduce misregistration errors. Using only a small number of patterns, the presented approach reduces measurement errors versus traditional structured light and phase matching methodologies while being insensitive to gamma distortion, projector flickering, and secondary reflections. Experimental results demonstrate these advantages in terms of enhanced 3D reconstruction performance in the presence of noise, deterministic distortions, and conditions of texture and depth contrast.

Phase shifting structured light illumination for range sensing involves projecting a set of grating patterns where accuracy is determined, in part, by the number of stripes. However, high pattern frequencies introduce ambiguities during phase unwrapping. This paper proposes a process for embedding a period cue into the projected pattern set without reducing the signal-to-noise ratio. As a result, each period of the high frequency signal can be identified. The proposed method can unwrap high frequency phase and achieve high measurement precision without increasing the pattern number. Therefore, the proposed method can significantly benefit real-time applications. The method is verified by theoretical and experimental analysis using prototype system built to achieve 120 fps at 640 × 480 resolution.