In June and July 2003 two Mars Exploration Rovers were launched to the Red Planet. Back on Earth, engineering-model rovers were driven on a mock Mars landscape in a large indoor sandbox. Characterizing their complete 6-DOF motion was accomplished by automatically acquiring dot targets mounted on their clattered, upper surfaces from any position and orientation within the sandbox using a system of 12 ceiling-mounted cameras. A least-squares, n-camera, triangulation technique was used to attain typical 3D accuracies of 1-2 cm within the 22m /spl times/ 9m test area.

The imaging services module of the Mars Exploration Rovers' on-board flight software is responsible for providing image data to the rest of the system. It acquires images from a suite of cameras, performs on-board image processing, labels the results with metadata, and delivers the final products to a diverse set of consumers, both on board and on the ground. The demands for flexibility and speed led to a design involving multiple tasks and a large set of parameters controlling the acquisition of the images, the on-board processing, and the method of product delivery.

The imaging system on the Mars Exploration Rovers has successfully operated on the surface of Mars for over one Earth year. The acquisition of hundreds of panoramas and tens of thousands of stereo pairs has enabled the rovers to explore Mars at a level of detail unprecedented in the history of space exploration. In addition to providing scientific value, the images also play a key role in the daily tactical operation of the rovers. The mobile nature of the MER surface mission requires extensive use of the imaging system for traverse planning, rover localization, remote sensing instrument targeting, and robotic arm placement. Each of these activity types requires a different set of data compression rates, surface coverage, and image acquisition strategies. An overview of the surface imaging activities is provided, along with a summary of the image data acquired to date.

In 1996, NASA will launch the Mars Pathfinder spacecraft, which will carry an 11 kg rover to explore the immediate vicinity of the lander. To assess the capabilities of the rover, the authors have constructed a new microrover testbed consisting of the Rocky 3.2 vehicle and an indoor test arena containing Mars analog terrain and overhead cameras for automatic, real-time tracking of the true rover position and heading. In this paper, the authors present initial performance evaluation results obtained with this testbed. The authors first decompose rover navigation into four major functions: goal designation, rover localization, hazard detection, and path selection. The authors then describe the Mars Pathfinder approach to each function, present results to date of evaluating the performance of each function, and outline their approach to enhancing performance for future missions. The results show key limitations in the quality of rover localization, the speed of hazard detection, and the ability of behavior control algorithms for path selection to negotiate the rock frequencies likely to be encountered on Mars.

To visually determine the position and orientation of a mobile robot from a fixed location in its vicinity, the authors have employed a cylindrical target which has different colors in each of its four quadrants. By judicious selection of the colors, segmentation of imagery from the fixed location can determine the size and centroid of the cylinder, as well as the visible color quadrants. Both the cylinder size in monocular images, and the centroid disparity in stereo pairs, are shown to provide a measure of distance. The angle of the cylinder is determined by analyzing which color quadrants are visible and to what degree. Implementation and experimental testing of this technique shows that it provides accurate localization data to within one or two pixels of error.

A program to develop planetary rover technology is underway at the Jet Propulsion Laboratory (JPL) under sponsorship of NASA. Developmental systems with the necessary sensing, computing, power, and mobility resources to demonstrate realistic forms of control for various missions have been developed, and initial testing has been completed. These testbed systems and the associated navigation techniques used are described. Particular emphasis is placed on three technologies: Computer-Aided Remote Driving (CARD), Semiautonomous Navigation (SAN), and behavior control. It is concluded that, through the development and evaluation of such technologies, research at JPL has expanded the set of viable planetary rover mission possibilities beyond the limits of remotely teleoperated systems such as Lunakhod. These are potentially applicable to exploration of all the solid planetary surfaces in the solar system, including Mars, Venus, and the moons of the gas giant planets.>

A useful space telerobot for on-orbit assembly, maintenance, and repair tasks must have a sensing and perception subsystem which can provide the locations, orientations, and velocities of all relevant objects in the work environment. This function must be accomplished with sufficient speed and accuracy to permit effective grappling and manipulation. Appropriate symbolic names must be attached to each object for use by higher-level planning algorithms. Sensor data and inferences must be presented to the remote human operator in a way that is both comprehensible in ensuring safe autonomous operation and useful for direct teleoperation. Research at JPL toward these objectives is described.