What you can see is what you can feel. - Development of a visual/haptic interface to virtual environment

Y. Yokokohji, Ralph Hollis, and Takeo Kanade
Proceedings of the IEEE Virtual Reality Annual International Symposium 1996 (VRAIS '96), April, 1996, pp. 46-53.


Download
  • Adobe portable document format (pdf) (249KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this paper, we propose a new concept of visual/haptic interfaces called WYSIWYF display. The proposed concept provides correct visual/haptic registration using a vision-based object tracking technique and a video keying technique so that what the user can see via a visual interface is consistent with what he/she can feel through a haptic interface.

Using Chroma Keying, a live video image of the user's hand is extracted and blended with the graphic scene of the virtual environment. The user's hand ``encounters'' the haptic device exactly when his/her hand touches a virtual object in the blended scene. The first prototype has been built and the proposed concept was demonstrated.


Keywords
haptic interface, registration, vision-based tracking

Notes
Associated Lab(s) / Group(s): Microdynamic Systems Laboratory
Associated Project(s): Magnetic Levitation Haptic Interfaces

Text Reference
Y. Yokokohji, Ralph Hollis, and Takeo Kanade, "What you can see is what you can feel. - Development of a visual/haptic interface to virtual environment," Proceedings of the IEEE Virtual Reality Annual International Symposium 1996 (VRAIS '96), April, 1996, pp. 46-53.

BibTeX Reference
@inproceedings{Hollis_1996_2322,
   author = "Y. Yokokohji and Ralph Hollis and Takeo Kanade",
   title = "What you can see is what you can feel. - Development of a visual/haptic interface to virtual environment",
   booktitle = "Proceedings of the IEEE Virtual Reality Annual International Symposium 1996 (VRAIS '96)",
   pages = "46-53",
   month = "April",
   year = "1996",
}