The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

This paper presents a new paradigm for data interaction called virtual video. The concept is that video streams can be interactively augmented in real-time by both addition and removal of visual information. Removed information must be seamlessly replaced with relevant ``background'' information. Added information can be in the form of computer graphics, as in conventional augmented reality, or imagery derived from the video stream itself. Adding video-derived imagery means that a ``real'' character can be simulated in different places or times in the video stream, or interacting (fictitiously) with other characters. Achieving this requires an understanding of the motion and appearance of the target character so that it can be realistically inserted. Video understanding technology is now sufficiently advanced to make interactive, real-time virtual video a possibility. An example is given in the form a computer game called Virtual Postman in which moving characters detected in a video stream can be ``killed'' and thus removed from that stream. Furthermore, characters detected in the video stream are stored, analysed for rigid or periodic motion and then smoothly re-inserted into the video stream at arbitrary places, times and scales as ``clones'' of live characters, or ``zombies'' of dead ones.

Notes

Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Associated Lab(s) / Group(s): Video Surveillance and Monitoring and People Image Analysis Consortium

Associated Project(s): Video Surveillance and Monitoring

Text Reference

Alan Lipton, "Virtual Postman - Real-Time Interactive Virtual Video," IASTED CGIM '99, October, 1999.

BibTeX Reference

@inproceedings{Lipton_1999_2933,
   author = "Alan Lipton",
   title = "Virtual Postman - Real-Time Interactive Virtual Video",
   booktitle = "IASTED CGIM '99",
   month = "October",
   year = "1999",
}

The Robotics Institute

Menu