Due to inadequate monitoring, key pollutants (e.g., PM2.5, VOCs, etc) very possibly leak into atmosphere, thus to endanger the long-term and short-term life safety of people that work and live in the environment. Therefore, it is imperative to effectively and efficiently detect the leakage of industrial waste gas, for the purpose of timely lowering the risk of pollution and explosions. To solve such a problem, we in this paper propose a new lightweight deep and wide network (LdwNet) for detecting the leakage of industrial waste gas from an image, which brings about the two main merits: 1) Compensating for the deficiencies of sensor-based detection methods, which can accurately detect the leakage of waste gas and even measure its concentrations but require to seek leakage sources beforehand; 2) Overcoming the shortcomings of image-based detection methods, which leverage DNN-based recognition technologies and usually suffer from low efficacy, low efficiency and high energy consumption during the model training and inference. To specify, the proposed LdwNet is developed by simulating human perception, motivated by the method which detects the leakage of industrial waste gas from surveillance images with the human observation and judgement. First, based on the inspiration that the human eyes are highly sensitive to horizontal and vertical stimuli, we construct a novel lightweight parallel-series-stripe (PS2) module to validly extract features with very few parameters. Second, to fully exploit deep and shallow features for fusing the global and local information, we extend the PS2 module as a backbone along both the deep and wide directions to build the multi-channel network. Third, to achieve effective, efficient and low-carbon detection in model running, we constraint the extended PS2 modules with parameter sharing to prodigiously reduce the model parameters and thus to make the proposed model ultra-lightweight. Experiments on the datasets of carbon particulate matters and ethylene leakage prove that our LdwNet with ten thousand parameters outperforms the state-of-the-art models with millions of parameters in detection accuracy and implementation cost, and this renders our proposed LdwNet more suitable for real industrial applications.

By comparison with the commonly seen visible light images that can be effectively characterized within a Euclidean space, infrared images have non-Euclidean characteristics since their pixels contain rich thermal radiation information, such as heat distribution, surface temperature and thermal radiation. Considering the advantages of Graph Convolutional Networks (GCNs) in processing non-Euclidean data, this study proposes to introduce the GCNs to estimate the quality of infrared images by developing the Node-to-Graph Regression (NGR) model. To specify, the proposed NGR model is composed of two main steps, namely network establishment and network training. In the first step, following the classical researches of image quality estimation that include local distortion measurement followed by pooling for inferring the image quality score, this study captures the local distortion of the input infrared images by stacking up a set of Vision Graph (VSG) blocks to generate one node map, and then conducts the weighted pooling method on the node map to yield the graph output as the estimated quality score. In the second step, for enhancing the model's performance and generalization ability in the network training process, this study implements the node regression with the big data pre-training method to raise the local distortion extraction ability in a broad range of image scenarios and distortion intensities, and then performs the graph regression by using the knowledge distillation method to reduce the over-fitting risk. Using the largest-size infrared image quality evaluation database (I2QED), this study compared the proposed NGR model with three dozen mainstream and state-of-the-art competitors, and results showed that our proposed NGR model achieved the optimal performance.

In this letter, a novel radar forward-looking imaging technique based on beam pattern modulation and beam scanning is presented. First, the chirp beam, which presents quadratic varying phases within the main lobe, is generated and scans as a chirp pulse propagating along the azimuth direction by differentially exciting each element of a uniform linear array (ULA). Second, the target distribution is successfully reconstructed using 2-D pulse compression, and a theoretical analysis of the azimuth resolution is conducted. Finally, the sparse representation (SR) technique is employed to enhance the imaging performance. Simulation and experimental results validate the effectiveness and potential of the proposed method for acquiring high-resolution forward-looking images. This work holds promise for advancing the development of radar forward-looking methods and systems.

Depending on high quality images, industrial vision technologies can basically oversee all the industrial production processes, such as workpiece processing and assembly automation, which play a highly significant role in promoting detection automation and production capacity in assembly lines. Unlike the natural scene images which consist of richer colors and natural lines, industrial images that cover complex industrial goods and equipment are made up of fewer colors, more regular shapes, massive graphic elements, etc., causing existing image processing methods for quality estimation, enhancement and monitoring to fail. Human beings usually play the part of the final receiver of an industrial image, so in the researches of image quality estimation, it is necessary to take the perception process of human eyes and brain to the input images into consideration. On this basis, we in this paper propose a novel perceptual information fidelity based image quality estimation model, abbreviated as PIF. Particularly, we first introduce a visual-cell low-pass filter and an optical-nerve noise model, which are separately inspired by the two processes: one is that an image in the form of optical signals arrives at the retina through the eye’s optical system to form the stimuli; the other is that the aforesaid stimuli in the form of electrical signals transfer to the human brain through the optical nerve. Second, we construct a novel image content-aware adjustor to optimize the above visual-cell low-pass filter and optical-nerve noise model. Third, we compare the two quantities of the information that is present in the clean image and how much of the information can be extracted from the lossy image to generate the overall quality score. Experiments on the two large-size industrial image quality databases demonstrate the excellent performance achieved by our proposed PIF model, with a remarkable performance gain over the existing state-of-the-art competitors.

This paper proposed a novel image-based air pollution monitor (IAPM) by incorporating local and global information in the self-adaptive multiscale transform domain, so as to achieve the timely and effective leakage detection of typical air pollutants from a single image. To be specific, this paper first developed a screen-shaped module according to two significant findings in visual neuroscience, which include the high sensitivity of human eyes to horizontal and vertical stimuli and the center-surround inhibition, by designing and fusing the square module, horizontal strip module and vertical strip module parallelly for simulating the behaviour of human eyes to extract local features. Second, the learnable weights and proportional mapping were applied to incorporate the screen-shaped module and lightweight vision transformer as backbone, towards more richly exploiting and fusing local and global information just as the way a brain perceives external stimuli. Third, a new self-adaptive multiscale transform domain method was devised based on two motivations from the visual characteristics of multiscale perception and the brain characteristics of self-adaptive domain transform to modify the backbone by using the operations of pooling and pointwise convolution. Extensive experiments implemented on the datasets of carbon particulate matters and ethylene leakage confirmed the superior monitoring performance of the proposed IAPM model beyond the state-of-the-art (SOTA) peers by an accuracy gain of about 4%. Furthermore, the proposed IAPM model only required 0.089 GFLOPs and 0.15 million model parameters, remarkably outperforming SOTA competitors in computational efficiency and storage resources.

Depth image-based rendering (DIBR) techniques play an essential role in free-viewpoint videos (FVVs), which generate the virtual views from a reference 2D texture video and its associated depth information. However, the background regions occluded by the foreground in the reference view will be exposed in the synthesized view, resulting in obvious irregular holes in the synthesized view. To this end, this paper proposes a novel coarse and fine-grained fusion hierarchical network (CFFHNet) for hole filling, which fills the irregular holes produced by view synthesis using the spatial contextual correlations between the visible and hole regions. CFFHNet adopts recurrent calculation to learn the spatial contextual correlation, while the hierarchical structure and attention mechanism are introduced to guide the fine-grained fusion of cross-scale contextual features. To promote texture generation while maintaining fidelity, we equip CFFHNet with a two-stage framework involving an inference sub-network to generate the coarse synthetic result and a refinement sub-network for refinement. Meanwhile, to make the learned hole-filling model better adaptable and robust to the "foreground penetration" distortion, we trained CFFHNet by generating a batch of training samples by adding irregular holes to the foreground and background connection regions of high-quality images. Extensive experiments show the superiority of our CFFHNet over the current state-of-the-art DIBR methods. The source code will be available at https://github.com/wgc-vsfm/view-synthesis-CFFHNet.

Microwave coincidence imaging (MCI) is a novel staring imaging technique with high resolution in azimuth. In MCI, the continuous imaging area is discretized into fine grids and the target-scattering centers are assumed to be exactly located at the centers of prediscretized grids. Recently, parametric methods are applied to MCI as target reconstruction algorithms with resolution enhancement and quality improvement. However, in practical applications, grid mismatch will severely degrade the imaging quality of parametric methods because the target-scattering centers will not totally locate at the grid centers no matter how fine the grids are. In this article, a reweighted-dynamic-grid-based MCI (RDG-MCI) method is proposed. In RDG-MCI, grids are evolving from coarse to dense iteratively rather than being fixed, and hence, off-grid errors can be eliminated gradually. Meanwhile, the reconstructed coefficients are used as weighting factors of grids in a form of weighting matrix in the next iteration and nonkey grids will be dropped out. Hence, the dynamic grids will be focused around the positions where target scatterers are most likely to exist. Furthermore, the matrix uncertain sparse Bayesian learning (MUSBL) algorithm is adopted to eliminate the residual off-grid errors. Finally, a preferable imaging result can be obtained based on the updated nonuniform grids. Also, the theoretical expected Cramér–Rao bound (ECRB) is also derived to evaluate the performance of the proposed method. The effectiveness of the proposed method, along with the super-resolution ability of MCI, is verified by simulations and outdoor experiments.

The electromagnetic (EM) vortex imaging has demonstrated superior performance in target detection and imaging with azimuthal super-resolution. However, the restricted elevation resolution degrades the acquisition of target spatial information, which limits the development of the radar imaging technology based on orbital angular momentum (OAM). This article offers a solution to achieve the 3-D EM vortex imaging, by effectively utilizing relative motion between radar and target in the line-of-sight (LOS) direction. First, the forward-looking radar imaging scenario is presented, the 3-D echo model is derived, and the characteristics are analyzed as well. Second, the imaging method, based on the back-projection (BP) and spectrum estimation method, is proposed to obtain the target’s 3-D focused image. Furthermore, the influence factors about the elevation resolution are analyzed by the point spread function (PSF). Finally, simulations are carried out to verify the effectiveness of the theoretical analyses.

This article devises a photograph-based monitoring model to estimate the real-time PM2.5concentrations, overcoming currently popular electrochemical sensor-based PM2.5monitoring methods’ shortcomings such as low-density spatial distribution and time delay. Combining the proposed monitoring model, the photographs taken by various camera devices (e.g., surveillance camera, automobile data recorder, and mobile phone) can widely monitor PM2.5concentration in megacities. This is beneficial to offering helpful decision-making information for atmospheric forecast and control, thus reducing the epidemic of COVID-19. To specify, the proposed model fuses Information Abundance measurement and Wide and Deep learning, dubbed as IAWD, for PM2.5monitoring. First, our model extracts two categories of features in a newly proposed DS transform space to measure the information abundance (IA) of a given photograph since the growth of PM2.5concentration decreases its IA. Second, to simultaneously possess the advantages of memorization and generalization, a new wide and deep neural network is devised to learn a nonlinear mapping between the above-mentioned extracted features and the groundtruth PM2.5concentration. Experiments on two recently established datasets totally including more than 100 000 photographs demonstrate the effectiveness of our extracted features and the superiority of our proposed IAWD model as compared to state-of-the-art relevant computing techniques.

Recently, the electromagnetic waves carrying orbital angular momentum are applied to radar imaging, which has the ability of azimuth resolution without motion limitation. The image reconstructed by Fourier transform method has low quality due to the high sidelobes and the duplicate of real target. In this paper, we reveal the reason in two cases with the help of point spread function. Then the least-squares (LS) method is adopted to get the high-quality imaging. The parameterized imaging model is detailed and several factors affecting the solution are discussed. Numerical experiments show that the results produced by using LS method are much nicer than that by Fourier technique when the noise and model error are not too serious. Moreover, the LS method can lower the limit of elevation angle. Finally, the imaging quality are analyzed quantitatively when the noise and model error are present.