This paper presents a method for the robust selection of measurements in a simultaneous localization and mapping (SLAM) framework. Existing methods check consistency or compatibility on a pairwise basis, however many measurement types are not sufficiently constrained in a pairwise scenario to determine if either measurement is inconsistent with the other. This paper presents group-$k$consistency maximization ($\mathrm{G}k\text{CM}$) that estimates the largest set of measurements that is internally group-$k$consistent. Solving for the largest set of group-$k$consistent measurements can be formulated as an instance of the maximum clique problem on generalized graphs and can be solved by adapting current methods. This paper evaluates the performance of$\mathrm{G}k\text{CM}$using simulated data and compares it to pairwise consistency maximization (PCM) presented in previous work.

ROSflight is a lean, open-source autopilot system developed with the primary goal of supporting the needs of researchers working with micro aerial vehicle systems. The project consists of firmware designed to run on low-cost, readily available flight controller boards, as well as ROS packages for interfacing between the flight controller and application code and for simulation. The core objectives of the project are as follows: maintain a small, easy-to-understand code base; provide high-bandwidth, low-latency communication between the flight controller and application code; provide a straightforward interface to research application code; allow for robust safety pilot integration; and enable true software-in-the-loop simulation capability.

Visual-inertial navigation methods have been shown to be an effective, low-cost way to operate autonomously without GPS or other global measurements, however most filtering approaches to VI suffer from observability and consistency problems. To increase robustness of the state-of-the-art methods, we propose a three-fold improvement. First, we propose the addition of a linear drag term in the velocity dynamics which improves estimation accuracy. Second, we propose the use of a partial-update formulation which limits the effect of linearization errors in partially-observable states, such as sensor biases. Finally, we propose the use of a keyframe reset step to enforce observability and consistency of the normally unobservable position and heading states. While all of these concepts have been used independently in the past, our experiments demonstrate additional strength when they are used simultaneously in a visual-inertial state estimation problem. In this paper, we derive the proposed filter and use a Monte Carlo simulation experiment to analyze the response of visual-inertial Kalman filters with the above described additions. The results of this study show that the combination of all of these features significantly improves estimation accuracy and consistency.

This paper demonstrates a feasible method for using a deep neural network as a sensor to estimate the attitude of a flying vehicle using only flight video. A dataset of still images and associated gravity vectors was collected and used to perform supervised learning. The network builds on a previously trained network and was trained to be able to approximate the attitude of the camera with an average error of about 8 degrees. Flight test video was recorded and processed with a relatively simple visual odometry method. The aircraft attitude is then estimated with the visual odometry as the state propagation and network providing the attitude measurement in an extended Kalman filter. Results show that the proposed method of having the neural network provide a gravity vector attitude measurement from the flight imagery reduces the standard deviation of the attitude error by approximately 12 times compared to a baseline approach.

This paper discusses the progress made on developing a multi-rotor helicopter equipped with a vision-based ability to navigate through an a priori unknown, GPS-denied environment. We highlight the backbone of our system, the relative estimation and control. We depart from the common practice of using a globally referenced map, preferring instead to keep the position and yaw states in the EKF relative to the current map node. This relative navigation approach allows simple application of sensor updates, natural characterization of the transformation between map nodes, and the potential to generate a globally consistent map when desired. The EKF fuses view matching data from a Microsoft Kinect with more frequent IMU data to provide state estimates at rates high enough to control the vehicles fast dynamics. Although an EKF is used, a nodes and edges graph represents the map. Hardware results showing the quality of the estimates and flights with estimates in the loop are provided.

We propose a new method to control a multi-rotor aerial vehicle. We show that the system dynamics are differentially flat. We utilize the differential flatness of the system to provide a feed forward input. The system model derived allows for arbitrary changes in yaw and is not limited to small roll and pitch angles. We demonstrate in hardware the ability to follow a highly maneuverable path while tracking a time-varying heading command.

Multirotor aircraft have become a popular platform for indoor flight. To navigate these vehicles indoors through an unknown environment requires the use of a SLAM algorithm, which can be processing intensive. However, their size, weight, and power capacity limit the processing capabilities available onboard. In this paper, we describe an approach to state estimation that helps to alleviate this problem. By using an improved dynamic model we show how to more accurately estimate the aircraft states than can be done with the traditional approach of integrating IMU measurements. The estimation is done with relatively infrequent corrections from accelerometers (40Hz) and even less frequent updates from a vision-based SLAM algorithm (2–5 Hz). This benefit of requiring less frequent updates from processing intensive sources comes without significant increase in the estimator's complexity.

It is often desirable for a human to manage multiple robots. Autonomy is required to keep workload within tolerable ranges, and dynamically adapting the type of autonomy may be useful for responding to environment and workload changes. We identify two management styles for managing multiple robots and present results from four experiments that have relevance to dynamic autonomy within these two management styles. These experiments, which involved 80 subjects, suggest that individual and team autonomy benefit from attention management aids, adaptive autonomy, and proper information abstraction.

A rotorcraft UAV provides an ideal experimental platform for vision-based navigation. This paper describes the flight tests of the US Army PALACE project, which implements Moravec's pseudo-normalized correlation tracking algorithm. The tracker uses the movement of the landing site in the camera, a laser range, and the aircraft attitude from an IMU to estimate the relative motion of the UAV. The position estimate functions as a GPS equivalent to enable the rotorcraft to maneuver without the aid of GPS. With GPS data as a baseline, tests were performed in simulation and inflight that measure the accuracy of the position estimation

In this paper, a method for accurate path following for miniature air vehicles is developed. The method is based on the notion of vector fields, which are used to generate desired course inputs to inner-loop attitude control laws. Vector-field path-following control laws are developed for straight-line paths and circular arcs and orbits. Lyapunov stability arguments are used to demonstrate asymptotic decay of path-following errors in the presence of constant wind disturbances. Experimental flight tests have demonstrated mean path-following errors on less than one wingspan for straight-line and orbit paths and less than three wingspans for paths with frequent changes in direction.

Numerous applications require aerial surveillance. Civilian applications include monitoring forest fires, oil fields, and pipelines and tracking wildlife. Applications to homeland security include border patrol and monitoring the perimeter of nuclear power plants. Military applications are numerous. The current approach to these applications is to use a single manned vehicle for surveillance. However, manned vehicles are typically large and expensive. In addition, hazardous environments and operator fatigue can potentially threaten the life of the pilot. Therefore, there is a critical need for automating aerial surveillance using unmanned air vehicles (UAVs). This paper gives an overview of a cooperative control strategy for aerial surveillance that has been successfully flight tested on small (48-in wingspan) UAVs. Our approach to cooperative control problems can be summarized in four steps: 1) the definition of a cooperation constraint and cooperation objective; 2) the definition of a coordination variable as the minimal amount of information needed to effect cooperation; 3) the design of a centralized cooperation strategy; and 4) the use of consensus schemes to transform the centralized strategy into a decentralized algorithm. The effectiveness of the solution will be shown using both high-fidelity simulation and actual flight tests

Presents an end-to-end solution to the battlefield scenario where M unmanned air vehicles are assigned to strike N known targets, in the presence of dynamic threats. The problem is decomposed into the subproblems of (1) cooperative target assignment, (2) coordinated UAV intercept, (3) path planning, and (4) feasible trajectory generation. The design technique is based on a hierarchical approach to coordinated control. Detailed simulation results are presented.

Presents an end-to-end solution to the cooperative control problem represented by the scenario where M unmanned air vehicles (UAVs) are assigned to transition through N known target locations in the presence of dynamic threats. The problem is decomposed into the subproblems of: 1) cooperative target assignment; 2) coordinated UAV intercept; 3) path planning; 4) feasible trajectory generation; and 5) asymptotic trajectory following. The design technique is based on a hierarchical approach to coordinated control. Simulation results are presented to demonstrate the effectiveness of the approach.

The application of a new nonlinear optimal control strategy to the station-keeping control of an underwater robotic vehicle is considered. The control approach described and demonstrated here is based upon the numerical approximation of solutions to the Hamilton-Jacobi-Bellman equation. These solutions are computed by an iterative application of Galerkin's method. Preliminary simulation results demonstrating the application of this approach to the control of an underwater vehicle in the horizontal plane are presented.