Visually Servoed Manipulation Using an Active Camera

Bradley Nelson and Pradeep Khosla
Thirty-Third Annual Allerton Conf. on Communication, Control, and Computing, October, 1995.

  • Adobe portable document format (pdf) (209KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Visual servoing is a robust technique for aligning both static and moving parts using imprecisely calibrated camera-lens-manipulator systems. An important limitation of these systems is the workspace within which the alignment task can be successfully performed due to the position and orientation of the camera. An active camera can extend this region, however this changes the visual representation of the task itself. Therefore, the reference input that drives the visually servoed manipulator must change appropriately. In this paper, a framework that allows for camera-lens motion during visually servoed manipulation is described. The main components of the framework include object schemas and port-based agents. Object schemas represent the task internally in terms of geometric models with attached sensor mappings. Object schemas are dynamically updated by sensor feedback, and thus provide an ability to perform three dimensional spatial reasoning during task execution, a capability traditional image-based visual servoing lacks. Object schemas are also able to dynamically create desired visual representations of the task from which reference inputs for vision-based control strategies are derived. The sensor mappings of object schemas are also used to guide camera motion based on task characteristics. Port-based agents are the executors of the visual reference inputs and the camera motion commands. They interact with the real world through visual servoing control laws. Experimental results that demonstrate system capabilities and performance are presented.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Text Reference
Bradley Nelson and Pradeep Khosla, "Visually Servoed Manipulation Using an Active Camera," Thirty-Third Annual Allerton Conf. on Communication, Control, and Computing, October, 1995.

BibTeX Reference
   author = "Bradley Nelson and Pradeep Khosla",
   title = "Visually Servoed Manipulation Using an Active Camera",
   booktitle = "Thirty-Third Annual Allerton Conf. on Communication, Control, and Computing",
   month = "October",
   year = "1995",