Incorporation of Audio in Virtualized Reality

Saurabh Gupta, Sundar Vedula, and Takeo Kanade
tech. report CMU-RI-TR-00-22, Robotics Institute, Carnegie Mellon University, September, 2000


Download
  • Adobe portable document format (pdf) (245KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Virtualized Reality is a visual medium that allows the user to view a scene from any viewpoint independent of the physical limitations imposed on the cameras capturing the scene. However the 3D models of video do not provide the complete simulation of the real world. We present an approach for the addition of audio to the existing video capture and recreation mechanisms. Using a technique analogous to video, multiple audio streams are captured to provide the spatial distribution of sound. A 3D model of audio is then generated to find the approximate sound as a function of the world coordinates. Synchronized with the video, this enables the user to both see and hear from any dynamically defined view-coordinates.

Keywords
virtualized reality, 3-d modeling, audio reconstruction

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Virtualized RealityTM

Text Reference
Saurabh Gupta, Sundar Vedula, and Takeo Kanade, "Incorporation of Audio in Virtualized Reality," tech. report CMU-RI-TR-00-22, Robotics Institute, Carnegie Mellon University, September, 2000

BibTeX Reference
@techreport{Vedula_2000_3451,
   author = "Saurabh Gupta and Sundar Vedula and Takeo Kanade",
   title = "Incorporation of Audio in Virtualized Reality",
   booktitle = "",
   institution = "Robotics Institute",
   month = "September",
   year = "2000",
   number= "CMU-RI-TR-00-22",
   address= "Pittsburgh, PA",
}