The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

In this paper, we propose a new concept of visual/haptic interfaces called WYSIWYF display. The proposed concept provides correct visual/haptic registration using a vision-based object tracking technique and a video keying technique so that what the user can see via a visual interface is consistent with what he/she can feel through a haptic interface.

Using Chroma Keying, a live video image of the user's hand is extracted and blended with the graphic scene of the virtual environment. The user's hand ``encounters'' the haptic device exactly when his/her hand touches a virtual object in the blended scene. The first prototype has been built and the proposed concept was demonstrated.

Keywords

haptic interface, registration, vision-based tracking

Notes

Associated Lab(s) / Group(s): Microdynamic Systems Laboratory

Associated Project(s): Magnetic Levitation Haptic Interfaces

Text Reference

Y. Yokokohji, Ralph Hollis, and Takeo Kanade, "What you can see is what you can feel. - Development of a visual/haptic interface to virtual environment," Proceedings of the IEEE Virtual Reality Annual International Symposium 1996 (VRAIS '96), April, 1996, pp. 46-53.

BibTeX Reference

@inproceedings{Hollis_1996_2322,
   author = "Y. Yokokohji and Ralph Hollis and Takeo Kanade",
   title = "What you can see is what you can feel. - Development of a visual/haptic interface to virtual environment",
   booktitle = "Proceedings of the IEEE Virtual Reality Annual International Symposium 1996 (VRAIS '96)",
   pages = "46-53",
   month = "April",
   year = "1996",
}

The Robotics Institute

Menu