Carnegie Mellon University
Motion estimation from image and inertial measurements

Dennis Strelow and Sanjiv Singh
The International Journal of Robotics Research, Vol. 23, No. 12, pp. 1157 - 1195, December, 2004.

  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Cameras and inertial sensors are each good candidates for autonomous vehicle navigation, modeling from video, and other applications that require six-degrees-of-freedom motion estimation. However, these sensors are also good candidates to be deployed together, since each can be used to resolve the ambiguities in estimated motion that result from using the other modality alone. In this paper, we consider the specific problem of estimating sensor motion and other unknowns from image, gyro, and accelerometer measurements, in environments without known fiducials. This paper targets applications where external positions references such as global positioning are not available, and focuses on the use of small and inexpensive inertial sensors, for applications where weight and cost requirements preclude the use of precision inertial navigation systems.

We present two algorithms for estimating sensor motion from image and inertial measurements. The first algorithm is a batch method, which produces estimates of the sensor motion, scene structure, and other unknowns using measurements from the entire observation sequence simultaneously. The second algorithm recovers sensor motion, scene structure, and other parameters recursively, and is suitable for use with long or "infinite" sequences, in which no feature is always visible.

We evaluate the accuracy of the algorithms and their sensitivity to their estimation parameters using a sequence of four experiments. These experiments focus on cases where estimates from image or inertial measurements alone are poor, on the relative advantage of using inertial measurements and omni directional images, and on long sequences in which the percentage of the image sequence in which individual features are visible is low.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Number of pages: 39

Text Reference
Dennis Strelow and Sanjiv Singh, "Motion estimation from image and inertial measurements," The International Journal of Robotics Research, Vol. 23, No. 12, pp. 1157 - 1195, December, 2004.

BibTeX Reference
   author = "Dennis Strelow and Sanjiv Singh",
   title = "Motion estimation from image and inertial measurements",
   journal = "The International Journal of Robotics Research",
   pages = "1157 - 1195",
   month = "December",
   year = "2004",
   volume = "23",
   number = "12",