Graphics enhanced version of this site

Integrating Force and Vision Feedback Within Virtual Environments for Telerobotic Systems
B. Nelson and P. Khosla
IEEE International Conference on Robotics and Automation (ICRA '97), Vol. 2, April, 1997, pp. 1588-1593.

Jump to: Download | Abstract | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [750 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Traditional telerobotic systems often provide feedback to the user through a variety of sensing modalities, for example through live video imagery, force reflection, or acoustic signals. When a supervisor guides a robotic task while immersed in a virtual environment, geometric representations of the world are provided as feedback. In this case, the supervisor interacts with the environment by visually observing these virtual objects and directing their motion. At issue is how to appropriately use various sensing modalities provided by disparate sensors in a system of this configuration. This paper focuses on assimilating the disparate feedback provided by force and vision sensors for telerobotic systems guided from within virtual environments. A framework for feedback assimilation is described based on the concept of sensor resolvability. Sensor resolvability is used in two ways, to update the virtual environment and to guide the desired task in the real world. Resolvability selects the appropriate sensing modality to use in updating the virtual environment within which the supervisor is immersed. It is also used to direct semi-autonomous agents that interact directly with the real world to perform the desired task. Experimental results demonstrate the significant advantages of assimilating disparate sensory feedback throughout a telerobotic task using the concept of sensor resolvability.

B. Nelson and P. Khosla, "Integrating Force and Vision Feedback Within Virtual Environments for Telerobotic Systems," IEEE International Conference on Robotics and Automation (ICRA '97), Vol. 2, April, 1997, pp. 1588-1593.

@inproceedings{Nelson_1997_989,
   author = "Bradley Nelson and Pradeep Khosla",
   title = "Integrating Force and Vision Feedback Within Virtual Environments for Telerobotic Systems",
   booktitle = "IEEE International Conference on Robotics and Automation (ICRA '97)",
   month = "April",
   year = "1997",
   volume = "2",
   pages = "1588-1593"
}