Convolutional neural networks (CNNs) have been shown to be a powerful tool for image classification. Recently, they have been adopted into the remote sensing community with applications in material classification from hyperspectral images. However, CNNs are time-consuming to train and often require large amounts of labeled training data. The widespread use of CNNs in the image processing and computer vision communities has been facilitated by the networks that have already been trained on large amounts of data. These pretrained networks can be used to initialize networks for new tasks. This transfer of knowledge makes it far less time-consuming to train a new classifier and reduces the need for a large labeled data set. This concept of transfer learning has not yet been fully explored by those using CNNs to train material classifiers from hyperspectral data. This paper provides an insight into training hyperspectral CNN classifiers by transferring knowledge from well labeled data sets to data sets that are less well labeled. It is shown that these CNNs can transfer between completely different domains and sensing platforms, and still improve classification performance. The application of this work is in the training of material classifiers of data acquired from field-based platforms, by transferring knowledge from publicly accessible airborne data sets. Factors, such as training set size, CNN architectures, and the impact of filter width and wavelength interval, are studied.

This paper proposes the Relit Spectral Angle-Stacked Autoencoder, a novel unsupervised feature learning approach for mapping pixel reflectances to illumination invariant encodings. This work extends the Spectral Angle-Stacked Autoencoder so that it can learn a shadow-invariant mapping. The method is inspired by a deep learning technique, Denoising Autoencoders, with the incorporation of a physics-based model for illumination such that the algorithm learns a shadow invariant mapping without the need for any labelled training data, additional sensors, a priori knowledge of the scene or the assumption of Planckian illumination. The method is evaluated using datasets captured from several different cameras, with experiments to demonstrate the illumination invariance of the features and how they can be used practically to improve the performance of high-level perception algorithms that operate on images acquired outdoors.

A cost effective approach to remote monitoring of protected areas such as marine reserves and restricted naval waters is to use passive sonar to detect, classify, localize, and track marine vessel activity (including small boats and autonomous underwater vehicles). Cepstral analysis of underwater acoustic data enables the time delay between the direct path arrival and the first multipath arrival to be measured, which in turn enables estimation of the instantaneous range of the source (a small boat). However, this conventional method is limited to ranges where the Lloyd's mirror effect (interference pattern formed between the direct and first multipath arrivals) is discernible. This paper proposes the use of convolutional neural networks (CNNs) for the joint detection and ranging of broadband acoustic noise sources such as marine vessels in conjunction with a data augmentation approach for improving network performance in varied signal-to-noise ratio (SNR) situations. Performance is compared with a conventional passive sonar ranging method for monitoring marine vessel activity using real data from a single hydrophone mounted above the sea floor. It is shown that CNNs operating on cepstrum data are able to detect the presence and estimate the range of transiting vessels at greater distances than the conventional method.

Outdoor robotic systems rely on perception modules that must be robust to variations in environmental conditions. In particular, vision-based perception systems are affected by illumination variations caused by occlusions. We propose an approach to calculate the lighting distribution of outdoor scenes. The new approach enables us to compensate for shadows and therefore obtain images which are invariant to the sun position and scene geometry, while also retaining the dimensionality of the original data. The method combines images with geometric information provided by range sensors to infer shadows. We select a pair of points on a shadow boundary from a single material and estimate a terrestrial sunlight-skylight ratio. Individual scaling factors are then calculated for all points based on their orientation and incident illumination sources. The result is a coloured point cloud that is independent of illumination variation due to occlusions and geometry. To demonstrate the effectiveness and generalisation of the approach, we present evaluations using two datasets with different cameras. The first uses a hyperspectral sensor that allows us to analyse the results for a large number of wavelengths, while the second dataset uses a standard RGB camera. The approach is shown to consistently provide good illumination compensation in both scenarios.

This paper presents an approach to automatically register hyperspectral images with lidar point clouds using a combination of SIFT and SURF feature descriptors. The aim is to generate 3D terrain maps of the environment combining spectral and geometrical information. The datasets are acquired from field-based platforms which, due to the lack of georeferencing, cannot be simply fused and require a registration processing step. In addition, some applications, such as in mining, cannot rely on reliable GPS signal. The proposed method is validated using experimental data acquired from vertical mine walls.