Integrating Sensor Placement and Visual Tracking Strategies

Bradley Nelson and Pradeep Khosla
Proc. 1994 IEEE Int. Conf. on Robotics and Automation, May, 1994, pp. 1351-1356.

  • Adobe portable document format (pdf) (491KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Real-time visual feedback is an important capability that many robotic systems must possess if these systems are to operate successfully in dynamically varying and imprecisely calibrated environments. An eye-in-hand system is a common technique for providing camera motion to increase the working region of a visual sensor. Although eye-in-hand robotic systems have been well-studied, several deficiencies in proposed systems make them inadequate for actual use. Typically, the systems fail if manipulators pass through singularities or joint limits. Objects being tracked can be lost if the objects become defocused, occluded, or if features on the objects lie outside the field of view of the camera. In this paper, a technique is introduced for integrating a visual tracking strategy with dynamically determined sensor placement criteria. This allows the system to automatically determine, in real-time, proper camera motion for tracking objects successfully while accounting for the undesirable, but often unavoidable, characteristics of camera-lens and manipulator systems. The sensor placement criteria considered include focus, field-of-view spatial resolution, manipulator configuration, and a newly introduced measure called resolvability. Experimental results are presented.


Text Reference
Bradley Nelson and Pradeep Khosla, "Integrating Sensor Placement and Visual Tracking Strategies," Proc. 1994 IEEE Int. Conf. on Robotics and Automation, May, 1994, pp. 1351-1356.

BibTeX Reference
   author = "Bradley Nelson and Pradeep Khosla",
   title = "Integrating Sensor Placement and Visual Tracking Strategies",
   booktitle = "Proc. 1994 IEEE Int. Conf. on Robotics and Automation",
   pages = "1351-1356",
   month = "May",
   year = "1994",
   volume = "2",