Camera–inertial measurement unit (IMU) sensor fusion has been extensively studied in recent decades. Numerous observability analysis and fusion schemes for motion estimation with self-calibration have been presented. However, it has been uncertain whether the intrinsic parameters of both the camera and the IMU are observable under general motion. To answer this question, by using the Lie derivatives, we first prove that for a rolling shutter (RS) camera–IMU system, all the intrinsic and extrinsic parameters, camera time offset, and readout time of the RS camera are observable with an unknown landmark. To our knowledge, we are the first to present such a proof. Next, to validate this analysis and to solve the drift issue of a structureless filter during standstills, we develop a keyframe-based sliding window filter (KSWF) for odometry and self-calibration, which works with a monocular RS camera or stereo RS cameras. Though the keyframe concept is widely used in vision-based sensor fusion, to our knowledge, the KSWF is the first of its kind to support self-calibration. Our simulation and real data tests have validated that it is possible to fully calibrate the camera–IMU system using the observations of opportunistic landmarks under diverse motion. Real data tests confirmed previous allusions that keeping landmarks in the state vector can remedy the drift in standstill and showed that the keyframe-based scheme is an alternative solution.

Analyses of GNSS-R data sets have revealed the occasional presence of coherent signals over land areas. Studies have been conducted of modeling such returns using classical scattering theories that consider the geometry, the frequency band, and surface parameters as inputs. The surface roughness is a crucial parameter that is not widely available from ancillary sources. This paper presents a comparison of roughness statistics derived from Digital Elevation Maps (DEMs) having different spatial resolutions, and shows the importance of having a high-resolution DEM in order to resolve small scale roughness. This is particularly important when modeling reflected signals over very flat surfaces where coherency can be significant.

High-Accuracy and high-efficiency 3-D sensing and associated data processing techniques are urgently needed for today’s roadway inventory, infrastructure health monitoring, autonomous driving, connected vehicles, urban modeling, and smart cities. 3D geospatial data acquired by digital photogrammetry or laser scanning or LiDAR systems have become one of the most critical data sources to support the above-mentioned applications. While progress has been made to applying 3D sensory data to those applications related to intelligent transportation systems (ITS), such as road network extraction, platform localization, obstacle avoidance, high-definition map generation, and transportation infrastructure inventory, many essential questions remain regarding the processing and understanding such massive 3D datasets in ITS-related applications. The authors have selected four articles for review in this Special issue. A summary of these articles is outlined below.

Space-based positioning, navigation, and timing (PNT) technologies, such as the global navigation satellite systems (GNSS) provide position, velocity, and timing information to an unlimited number of users around the world. In recent years, PNT information has become increasingly critical to the security, safety, and prosperity of the World's population, and is now widely recognized as an essential element of the global information infrastructure. Due to its vulnerabilities and line-of-sight requirements, GNSS alone is unable to provide PNT with the required levels of integrity, accuracy, continuity, and reliability. A multisensor navigation approach offers an effective augmentation in GNSS-challenged environments that holds a promise of delivering robust and resilient PNT. Traditionally, sensors such as inertial measurement units (IMUs), barometers, magnetometers, odometers, and digital compasses, have been used. However, recent trends have largely focused on image-based, terrain-based and collaborative navigation to recover the user location. This paper offers a review of the technological advances that have taken place in PNT over the last two decades, and discusses various hybridizations of multisensory systems, building upon the fundamental GNSS/IMU integration. The most important conclusion of this study is that in order to meet the challenging goals of delivering continuous, accurate and robust PNT to the ever-growing numbers of users, the hybridization of a suite of different PNT solutions is required.

Full Waveform Data (FWD) has been increasingly becoming available on modern airborne LiDAR systems. Since the waveform signal is noisy and rather sparse by nature, the compressed FWD representation has several advantages. First, the reduced data volume makes the storage and transmission of waveform data faster and more economic. Second, the sparse representation based on proper feature space selection may potentially support the subsequent waveform interpretation and classification processes. Note that discrete return data represent the most basic compressed waveform representation. This study addresses some aspects of FWD compression. First, the wavelet family selection for FWD compression is analyzed, including compression ratio, average/maximum reconstruction errors. Next wavelet filter optimization with respect to typical FWD is investigated. Finally, the performance potential of compressive sampling is assessed along with a brief insight into wavelet representation based waveform classification.

An integrated positioning solution termed ‘collaborative positioning’ employs multiple location sensors with different accuracy on different platforms for sharing of their absolute and relative localizations. Typical application scenarios are dismounted soldiers, swarms of UAV's, team of robots, emergency crews and first responders. The stakeholders of the solution (i.e., mobile sensors, users, fixed stations and external databases) are involved in an iterative algorithm to estimate or improve the accuracy of each node's position based on statistical models. This paper studies the challenges to realize a public and low-cost solution, based on mass users of multiple-sensor platforms. For the investigation field experiments revolved around the concept of collaborative navigation, and partially indoor navigation. For this purpose different sensor platforms have been fitted with similar type of sensors, such as geodetic and low-cost high-sensitivity GNSS receivers, tactical grade IMU's, MEMS-based IMU's, miscellaneous sensors, including magnetometers, barometric pressure and step sensors, as well as image sensors, such as digital cameras and Flash LiDAR, and ultra-wide band (UWB) receivers. The employed platforms in the tests include a train on a building roof, mobile mapping vans, a personal navigator and a foot tracker unit. In terms of the tests, the data from the different platforms are recorded simultaneously. Several field experiments conducted in a week at the University of Nottingham are described and investigated in the paper. The personal navigator and a foot tracker unit moved on the building roof, then trough the building down to where it logged data simultaneously with the vans, all of them moving together and relative to each other. The platforms then logged data simultaneously covering various accelerations, dynamics, etc. over longer trajectories. Promising preliminary results of the field experiments showed that a positioning accuracy on the few meter level can be achieved for the navigation of the different platforms.