/Vision-based Visual/Haptic Registration for WYSIWYF Display

Vision-based Visual/Haptic Registration for WYSIWYF Display

Y. Yokokohji, Ralph Hollis and Takeo Kanade
Conference Paper, International Conference on Intelligent Robots and Systems, IROS '96, Vol. 3, pp. 1386 - 1393, November, 1996

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


We have been working on developing a visual/haptic interface for virtual environments. The authors have previously (1996) proposed a WYSIWYF (What You See Is What You Feel) concept which ensures a correct visual/haptic registration so that what the user can see via a visual interface is consistent with what he/she can feel through a haptic interface. The key components of the WYSIWYF display are (i) vision-based tracking, (ii) video keying, and (iii) physically-based simulation. The first prototype has been built and the proposed concept was demonstrated. It turned out, however, that the original system had a bottleneck in the vision tracking component and the performance was not satisfactory (slow frame rate and large latency). To solve the problem of our first prototype, we have implemented a fast tracker which can track more than 100 markers in video-rate. In this paper, new experimental results are shown followed by the improvements of the vision-based tracking component.

BibTeX Reference
author = {Y. Yokokohji and Ralph Hollis and Takeo Kanade},
title = {Vision-based Visual/Haptic Registration for WYSIWYF Display},
booktitle = {International Conference on Intelligent Robots and Systems, IROS '96},
year = {1996},
month = {November},
volume = {3},
pages = {1386 - 1393},