Carnegie Mellon University
Overlaying Ultrasound Images on Direct Vision

George D. Stetten and V. Chib
Journal of Ultrasound in Medicine, Vol. 20, No. 3, pp. 235 - 240, 2001.

  • Adobe portable document format (pdf) (861KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

The objective of this technical advance is to permit in situ visualization of ultrasonographic images so that direct hand-eye coordination can be used during invasive procedures. A method is presented that merges the visual outer surface of a patient with a simultaneous ultrasonographic scan of the patient's interior. The method combines a flat-panel monitor with a half-silvered mirror such that the image on the monitor is reflected precisely at the proper location within the patient. The ultrasonographic image is superimposed in real time on the patient, merging with the operator's hands and any invasive tools in the field of view. Instead of looking away from the patient at an ultrasonographic monitor, the opera- tor sees through skin and underlying tissue as if it were translucent. Two working proto- types have been constructed, demonstrating independence of viewer location and requiring no special apparatus to be worn by the operator. This method could enable needles and scalpels to be manipulated with direct hand-eye coordination under ultrasonographic guid- ance. Invasive tools would be visible up to where they enter the skin, permitting natural visual extrapolation into the ultrasonographic slice. Biopsy needles would no longer be restricted to lie in the plane of the ultrasonographic scan but could instead intersect it. These advances could lead to increased safety, ease, and reliability in certain invasive procedures. Key words: tomographic reflection; ultrasonographically guided biopsy; image overlay; aug- mented reality; visualization; percutaneous.

Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Quality of Life Technology Center
Associated Lab(s) / Group(s): Human-Robot Interaction Group
Associated Project(s): Sonic FlashlightTM
Number of pages: 6

Text Reference
George D. Stetten and V. Chib, "Overlaying Ultrasound Images on Direct Vision," Journal of Ultrasound in Medicine, Vol. 20, No. 3, pp. 235 - 240, 2001.

BibTeX Reference
   author = "George D Stetten and V. Chib",
   title = "Overlaying Ultrasound Images on Direct Vision",
   journal = "Journal of Ultrasound in Medicine",
   pages = "235 - 240",
   year = "2001",
   volume = "20",
   number = "3",