The main contribution of this paper is a novel Extended Kalman Filter (EKF) based localisation scheme that fuses two complementary approaches to outdoor vision based localisation. This EKF is aided by a front end consisting of two Convolutional Neural Networks (CNNs) that provide the necessary perceptual information from camera images. The first approach involves a CNN based extraction of information corresponding to artefacts such as curbs, lane markings, and manhole covers to localise on a vector distance transform representation of a binary image of these ground surface boundaries. The second approach involves a CNN based detection of common environmental landmarks such as tree trunks and light poles, which are represented as point features on a sparse map. Utilising CNNs to obtain higher level information about the environment enables this framework to avoid the typical pitfalls of common vision based approaches that use low level hand crafted features for localisation. The EKF framework makes it possible to deal with false positives and missed detections that are inevitable in a practical CNN, to produce a location estimate together with its associated uncertainty. Experiments using a Personal Mobility Device (PMD) driven in typical suburban streets are presented to demonstrate the effectiveness of the proposed localiser.

This work presents a real-time localization system developed for professional care givers to track residents of an aged care facility during their visits to a crowded, multi-story shopping mall. The proposed system consists of a Wi-Fi based self-localization platform integrated into a wheeled walking frame and an application installed in a hand-held tablet device for displaying the locations of walker users. The density of people in the shopping mall changes significantly during the day thus the expected Wi-Fi signal strength at a given location is subject to large variations. However, Identifying the location to be within a given area is adequate and the average speed of motion is less than 0.5 m/sec. In this paper, an algorithm that addresses these unique requirements is presented. We exploit the signal strength characteristics of existing Wi-Fi network and prior knowledge of the building floor plans for developing our core algorithm. The environments is divided in to cells that are either enclosed spaces or divisions of larger open regions. The probability density function of the Wi-Fi signal strength of each cell is estimated using Kernel Density Estimation (KDE) and is used in a probabilistic framework to estimate the user location. Motion model of the users as well as the detection of floor transition events are used to enhance the performance of the location estimator. The algorithm was implemented using an Odroid-C1 computer and a tablet with Android operating system. Results obtained during field trials at Roselands Shopping Mall in Sydney are presented.

This paper presents an algorithm for localizing an unmanned aerial vehicle (UAV) in GPS denied environments. Localization is performed with respect to a pre-built map of the environment represented using the distance function of a binary mosaic, avoiding the need for extraction and explicit matching of visual features. Edges extracted from images acquired by an on-board camera are projected to the map to compute an error metric that indicates the misalignment between the predicted and true pose of the UAV. A constrained extended Kalman filter (EKF) framework is used to generate an estimate of the full 6-DOF location of the UAV by enforcing the condition that the distance function values are zero when there is no misalignment. Use of an EKF also makes it possible to seamlessly incorporate information from any other system on the UAV, for example, from its auto-pilot, a height sensor or an optical flow sensor. Experiments using a hexarotor UAV both in a simulation environment and in the field are presented to demonstrate the effectiveness of the proposed algorithm.