Carnegie Mellon University
Interactive Multi-Modal Robot Programming

Soshi Iba, Chris Paredis, and Pradeep Khosla
9th International Symposium on Experimental Robotics, June, 2004.

  • Adobe portable document format (pdf) (726KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

The goal of the Interactive Multi-Modal Robot Programming system is a comprehensive human-machine interface that allows non-experts to compose robot programs conveniently. Two key characteristics of this novel programming approach are that the user can provide feedback interactively at any time through an intuitive interface and that the system infers the user's intent to support interaction. The framework takes a three-step approach to the problem: multi-modal recognition, intention interpretation, and prioritized task execution. The system is demonstrated by interactively controlling and programming a mobile vacuum cleaning robot. The demonstrations are used to exemplify the interactive programming and plan recognition aspects of the research.

Associated Center(s) / Consortia: National Robotics Engineering Center
Associated Lab(s) / Group(s): Advanced Mechatronics Lab
Number of pages: 10

Text Reference
Soshi Iba, Chris Paredis, and Pradeep Khosla , "Interactive Multi-Modal Robot Programming," 9th International Symposium on Experimental Robotics, June, 2004.

BibTeX Reference
   author = "Soshi Iba and Chris Paredis and Pradeep {Khosla }",
   title = "Interactive Multi-Modal Robot Programming",
   booktitle = "9th International Symposium on Experimental Robotics",
   month = "June",
   year = "2004",