Event cameras, which feature pixels that independently respond to changes in brightness, are becoming increasingly popular in high- speed applications due to their lower latency, reduced bandwidth requirements, and enhanced dynamic range compared to traditional frame- based cameras. Numerous imaging and vision techniques have leveraged event cameras for high- speed scene understanding by capturing high- framerate, high- dynamic range videos, primarily utilizing the temporal advantages inherent to event cameras. Additionally, imaging and vision techniques have utilized the light field—a complementary dimension to temporal information—for enhanced scene understanding.In this work, we propose "Event Fields", a new approach that utilizes innovative optical designs for event cameras to capture light fields at high speed. We develop the underlying mathematical framework for Event Fields and introduce two foundational frameworks to capture them practically: spatial multiplexing to capture temporal derivatives and temporal multiplexing to capture angular derivatives. To realize these, we design two complementary optical setups— one using a kaleidoscope for spatial multiplexing and another using a galvanometer for temporal multiplexing. We evaluate the performance of both designs using a custom-built simulator and real hardware prototypes, showcasing their distinct benefits. Our event fields unlock the full advantages of typical light fields—like post- capture refocusing and depth estimation—now supercharged for high- speed and high- dynamic range scenes. This novel light- sensing paradigm opens doors to new applications in photography, robotics, and AR/VR, and presents fresh challenges in rendering and machine learning.

Human perception of speed is largely driven by visual cues. However, our subjective estimations of speed are influenced by several factors that can lead to deceptive cues and speed misperception. While some prior studies have explored individual effects on speed perception, such as contrast, spatial frequency, and temporal frequency, their combined influence remains underexamined, particularly in immersive VR environments. In this work, we systematically investigate the influence and interplay of four visual factors—contrast, spatial frequency, temporal frequency, and eccentricity—on human perception of speed. To this end, we conduct a psychophysical study measuring subjective speed judgments across controlled stimuli and reveal significant perceptual biases induced by these factors. Based on our collected data, we learn a model to predict the underestimation or overestimation of perceived speed from visual scene properties. We apply and validate our findings in three immersive environments and demonstrate their influence on common VR scenarios. Finally, we discuss how understanding the factors that shape speed perception can drive the design of perceptually aligned virtual environments, with potential future applications such as correcting speed misperception and conceivably mitigating visual-vestibular conflicts by modulating perceived speed.

Face video restoration (FVR) is a challenging but important problem where one seeks to recover a perceptually realistic face videos from a low-quality input. While diffusion probabilistic models (DPMs) have been shown to achieve remarkable performance for face image restoration, they often fail to preserve temporally coherent, high-quality videos, compromising the fidelity of reconstructed faces. We present a new conditional diffusion framework called FLAIR for FVR. FLAIR ensures improved temporal alignments across frames in a computationally efficient fashion by converting a traditional image DPM into a video DPM. The proposed conversion uses a recurrent video refinement layer and a temporal self-attention at different scales. FLAIR also uses a conditional iterative refinement process to balance the perceptual and distortion quality during inference. This process consists of two key components: a data-consistency module that analytically ensures that the generated video precisely matches its degraded observation and a coarse-to-fine image enhancement module specifically for facial regions. Our extensive experiments show superiority of FLAIR over the current state-of-the-art (SOTA) for video super-resolution, deblurring, JPEG restoration, and space-time frame interpolation on two high-quality face video datasets.

A spaceborne bistatic surveillance radar system, which may increase the target radar cross section through a large bistatic angle, can effectively improve the performance of small air moving target indication. However, due to the separation of the transmitter and the receiver, the clutter exhibits severe range dependence in both Doppler and spatial-angle domains. This may significantly decrease the number of independent identically distributed samples and, thus, cause the degradation of clutter suppression performance. In addition, when an air moving target flies above the sea, the broadened spectrum of sea clutter caused by the random intrinsic motion will further influence the clutter suppression performance. To deal with these problems, this article establishes a multichannel sea clutter model for a spaceborne bistatic surveillance radar system. The calculation of the positions of the iso-range contours is analyzed first. Then, the bistatic sea clutter model is established based on the directional wave spectrum, the monostatic–bistatic equivalence theorem, and the two-scale scattering model, where the Earth rotation and the range ambiguity of clutter are considered. Finally, the range dependence and the spectrum characteristics of bistatic sea clutter are discussed, and the clutter suppression performances under different azimuth bistatic angles, different elevation angles, and different sea states are analyzed. In addition, the influence of clutter range ambiguity is analyzed based on the simulations.

Deep model-based architectures (DMBAs) are widely used in imaging inverse problems to integrate physical measurement models and learned image priors. Plug-and-play priors (PnP) and deep equilibrium models (DEQ) are two DMBA frameworks that have received significant attention. The key difference between the two is that the image prior in DEQ is trained by using a specific measurement model, while that in PnP is trained as a general image denoiser. This difference is behind a common assumption that PnP is more robust to changes in the measurement models compared to DEQ. This paper investigates the robustness of DEQ priors to changes in the measurement models. Our results on two imaging inverse problems suggest that DEQ priors trained under mismatched measurement models outperform image denoisers.

For air moving target indication in nadir region, due to the fact that a spaceborne radar beam can illuminate the top of fuselage, the target radar cross section is usually high, which is beneficial for the detection of a low-observable target. However, due to the short slant range, specular reflection effect, and relatively low radar ground resolution, the power of clutter component from nadir region is comparatively high, leading to the insufficient clutter suppression and the degradation of target detection performance. Fortunately, when an air moving target is adequately high, the target echo is able to be separated from the main clutter echoes due to a shorter time delay, making it possible to be only mixed with low-power ambiguous clutter echoes. Based on these considerations, this paper analyzes the performance of air moving target indication in nadir region for a spaceborne surveillance radar system. It analyzes the target minimum detectable velocities with different target heights and beam center elevation angles. Also, an effective sample selection method based on adaptive range segmentation is proposed to solve the power heterogeneity issue between the main clutter area and the range ambiguous clutter area. As a conclusion, the larger the elevation angle of an air moving target is, the higher the minimum target detectable height is.

Sea clutter magnitude distribution exhibits important guiding significance for the design of marine target detection algorithms and the selection of the constant false alarm rate (CFAR) detection threshold. In this letter, to deal with the limitation of the traditional generalized-K (GK) distribution in highly heterogeneous clutter scene, a modified GK (MGK) distribution is proposed for sea clutter magnitude. By combining the traditional GK and generalized Pareto distributions, the value range of power parameter and the applicable range of the distribution model are extended. The applicability of the proposed distribution model is verified by real-measured sea clutter data.

Due to the high-speed movement of a spaceborne radar (SBR) platform, the geographic clutter spectrum expands severely, resulting in the useful moving target signal submerged by the main-lobe clutter background. To deal with this issue, the equipped multichannel arrays in an SBR system provide sufficient spatial degrees, and as a consequence, the space-time adaptive processing (STAP) technology is often preferred to achieve the moving target detection, even in the main-lobe clutter regions. However, for the moving target detection under the sea scene, due to the complex internal motion of sea clutter, the clutter signal received by an SBR system may possess the space- and time-varying characteristics, worsening the multichannel clutter rejection performance using the traditional STAP techniques. In this article, a novel sea clutter suppression method based on the joint space-time-frequency adaptive filtering is proposed. In the proposed algorithm, according to the coherent time analysis of sea clutter, the subaperture time-domain sliding window is employed to alleviate the clutter decorrelation effect, and then, a modified subspace projection technique is applied to accomplish the first-stage clutter rejection. After realizing the effective signal recovery with respect to these residual subaperture clutter data, the second-stage spatial filtering method is applied to realize the final clutter suppression with respect to the relatively high Doppler resolution clutter returns. The effectiveness of the proposed algorithm is verified by both simulated multichannel sea clutter data and real-measured sea clutter data.

When an early warning radar installed in a spaceborne platform works in a down-looking mode to detect a low-altitude flying target, the severely broadened main-lobe clutter cannot be ignored, which will cause the deterioration of the moving target detection capability. To deal with this problem, a space–time adaptive processing (STAP) technique is proposed for effective clutter suppression based on the spatial–temporal 2-D joint filtering. However, the full-dimensional optimal STAP encounters the challenges of high computational complexity and large training sample requirement. Therefore, the dimension-reduced STAP technique becomes necessary. This article proposes a novel dimension-reduced STAP algorithm based on spatial–temporal 2-D sliding window processing. First, several sets of spatial–temporal data are obtained by using spatial–temporal 2-D sliding window. Then, for each set of data, the 2-D discrete Fourier transform is performed to transform the echo data into the angle-Doppler domain. Finally, jointly adaptive processing is performed to realize the clutter suppression. Compared with the conventional STAP algorithms, the improvements of this method over the existing methods are: 1) the proposed method requires fewer training samples due to the 2-D localization processing and 2) the proposed method can obtain the better clutter suppression performance with lower computational complexity. The feasibility and effectiveness of the proposed algorithm are verified by both simulated and real-measured multichannel surveillance radar data.

In this letter, a novel method is proposed to estimate the along-track baseline for a multichannel synthetic aperture radar (SAR) system, intended for ground moving target indication (GMTI) applications. First, an adaptive spectrum filtering technique is proposed to compensate the terrain interferometric phase caused by the cross-track baseline and then the ground clutter is rejected by applying the joint-pixel displaced phase center antenna (JPDPCA). After performing the moving target detection, the target radial velocity is estimated according to the azimuth position offset by exploiting the road-aided information. Finally, the along-track baseline is derived based on the subspace projection (SP). The effectiveness of the proposed method is validated by data from the experimental airborne system.

In this article, we propose a multichannel sea clutter model in a spaceborne early warning radar system and analyze the influence of the sea clutter motion characteristics on the space-time adaptive processing (STAP) performance. To establish a multichannel sea clutter model, the 3-D Gerstner wave model is applied to construct the sea surface. Then the Pierson–Moskowitz wave spectrum and the stereo wave observation project (SWOP) directional spectrum are combined to describe the amplitude distribution of waves in different frequencies and directions. At the same time, the two-scale model is applied to obtain the specific backscattering coefficients of sea clutter at different time and positions. In addition, breaking waves are added in sea clutter returns with the form of false targets. Finally, the space-time distribution characteristics of sea clutter in a spaceborne multichannel array system and the influences of sea clutter under different wind speeds and directions on STAP performance are analyzed based on the simulation processing results. Processing results of some real-measured radar data are also exhibited to verify the theoretical analyses.