This paper presents our work from an on going project on motion and pose estimation for supporting vision-guided fine manipulation of orbital replaceable units in a cluttered environment. The major challenges of this work include target objects, some with highly reflective or mirror surfaces, moving in a cluttered environment with changing illumination. These challenges are dealt with through closed-looped integration of video from multiple cameras and manipulator joint angle measurements, along with moving edge detection and model-based feature tracking. A powerful technique based on a Lie group and its associated Lie algebra is employed for pose estimation. Eflectiveness of the proposed techniques is illustrated by good test results for data acquired in the laboratory.

Although many algorithms have been developed for motion estimation from range images, none are suited for use with scanning laser sensors. In this paper, the feature-based motion transformation model is restated to incorporate the nonzero pixel sampling rate of laser range cameras and a novel iterative, linear, feature-based technique for determining the 3D motion transformation of moving objects is developed using this new model. A technique is then presented which employs the motion recovered using the iterative algorithm to remove the structural distortion of the object in the range map. The performance of the motion recovery method is verified using simulated and experimental data.

A technique is presented for recognizing a 3D object (a model in an image library) from a single 2D silhouette using information such as corners (points with high positive curvatures) and occluding contours, rather than straight line segments. The silhouette is assumed to be a parallel projection of the object. Each model is stored as a set of the principal quadtrees, from which the volume/surface octree of the model is generated. Feature points (i.e. corners) are extracted to guide the recognition process. Four-point correspondences between the 2D feature points of the observed object and 3D feature points of each model are hypothesized, and then verified by applying a variety of constraints to their associated viewing parameters. The result of the hypothesis and verification process is further validated by 2D contour matching. This approach allows for a method of handling both planar and curved objects in a uniform manner, and provides a solution to the recognition of multiple objects with occlusion as demonstrated by the experimental results.>

With the advent of devices that can directly sense and determine the coordinates of points in space, the goal of constructing and recognizing descriptors of three-dimensional (3-D) objects is attracting the attention of many researchers in the image processing community. Unfortunately, the time required to fully sense a range image is large relative to the time required to sense an intensity image. Conversely, a single intensity image lacks the depth information required to construct 3-D object descriptors. This paper presents a method of combining the two sensory sources, intensity and range, such that the time required for range sensing is considerably reduced. The approach is to extract potential points of interest from the intensity image and then selectively sense range at these feature points. After the range information is known at these points, a graph structure representing the object in the scene is constructed. This structure is compared to the stored graph models using an algorithm for partial matching. The results of applying the method to both synthetic data and real intensity/range images are presented.