Carnegie Mellon University
Efficacy of Image-Guided Action is Controlled by Perception

Roberta Klatzky, Bing Wu, Damion Michael Shelton, and George D. Stetten
Vision Sciences Society conference, May, 2005.

  • Adobe portable document format (pdf) (386KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Researchers on human perception have devised a number of methods for measuring perceived location and using it to assess perceptually guided action. Such work has primarily been performed in space accessible by reaching and walking. Here we use the same approach to assess perceptually guided action in very near space, specifically, in the applied context of ultrasound-guided surgical manipulation. Our approach measured the ultrasound user? perception of the location of a target independently from assessing the action employed to reach it. Experiments were conducted with the Sonic Flashlight (SF), a visualization device that creates a virtual in situ image, and conventional ultrasound (CUS), which displays the image on a screen displaced from the target. Two studies determined subjects?perception of target location with a triangulation-by-pointing task. Depth perception with the SF was comparable to direct vision, while the CUS caused considerable underestimation of target depth. Binocular depth information in the SF was shown to significantly contribute to its superiority. A third experiment tested subjects in an ultrasound-guided needle insertion task. With direct visualization of the target, subjects performed insertions faster and more accurately by using the SF rather than CUS. Furthermore, the trajectory analysis showed that insertions with the SF generally went directly to the target along the desired path, while the CUS led to an arc-shaped deviation from the ideal path, as predicted by the previously measured underestimation of target depth. Ongoing research is further examining the time-course of learning with the two devices, measuring precise trajectories for needle insertion. This work extends the demonstration of the perception/action linkage to near space and provides a very practical application for such research. In particular, different image methods, which lead to different percepts, will lead to actions with differential efficacy.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Quality of Life Technology Center
Associated Lab(s) / Group(s): Human-Robot Interaction Group
Associated Project(s): Sonic FlashlightTM
Number of pages: 1
Note: abstract to appear in the Journal of Vision

Text Reference
Roberta Klatzky, Bing Wu, Damion Michael Shelton, and George D. Stetten, "Efficacy of Image-Guided Action is Controlled by Perception," Vision Sciences Society conference, May, 2005.

BibTeX Reference
   author = "Roberta Klatzky and Bing Wu and Damion Michael Shelton and George D Stetten",
   title = "Efficacy of Image-Guided Action is Controlled by Perception",
   journal = "Vision Sciences Society conference",
   month = "May",
   year = "2005",
   Notes = "abstract to appear in the Journal of Vision"