Carnegie Mellon University
Team-Centered Virtual Interactive Presence for Adjustable Autonomy

J. Reitsema, Wendell Chun, Terrence W. Fong, and Randy Stiles
AIAA Space 2005, September, 2005.

  • Adobe portable document format (pdf) (5MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Current solutions for autonomy plan creation, monitoring and modification are complex, resulting in loss of flexibility and safety. The size of ground control operations and the number of aviation accidents involving automation are clear indicators of this problem. The solution is for humans to naturally collaborate with autonomous systems. Visual spatial information is a common reference for increased team situation awareness between humans and adaptive autonomous systems such as robots, satellites, and agents. We use a teamcentered, augmented reality spatial dialog approach to improve human-automation interaction for collaborative assembly, repair, and exploration. With our spatial dialog approach, we provide a data-rich virtual interactive presence for collaborating with autonomous systems by incorporating the spatial context along with the spoken context.Spatial Dialog is an interaction and communication technology that uses a deeper understanding of spatial context and a richer spatial vocabulary to realize improved human-computer symbiosis. Spatial context is useful for communicating, understanding and remembering information. It includes the location of objects and people, and the place in which events are occurring. Using computers that see, we can pick out faces in a scene, track people, and follow where people are pointing and the objects they use. Using augmented reality and a real-time understanding of the spatial scene, we can overlay information on the real world or virtual models as a key spatial component of the dialog process, especially for remote virtual tele-presence, tele-supervision, and tele-science cases.

human-robot interaction, space exploration, spatial dialogue

Number of pages: 12
Note: AIAA-2005-6606

Text Reference
J. Reitsema, Wendell Chun, Terrence W. Fong, and Randy Stiles, "Team-Centered Virtual Interactive Presence for Adjustable Autonomy," AIAA Space 2005, September, 2005.

BibTeX Reference
   author = "J. Reitsema and Wendell Chun and Terrence W Fong and Randy Stiles",
   title = "Team-Centered Virtual Interactive Presence for Adjustable Autonomy",
   booktitle = "AIAA Space 2005",
   month = "September",
   year = "2005",
   Notes = "AIAA-2005-6606"