The Oz of Wizard: Simulating the Human for Interaction Research

Aaron Steinfeld, Odest Chadwicke Jenkins, and Brian Scassellati
ACM/IEEE International Conference on Human-Robot Interaction (HRI), March, 2009.


Download
  • Adobe portable document format (pdf) (727KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
The Wizard of Oz experiment method has a long tradition of acceptance and use within the field of human-robot interaction. The community has traditionally downplayed the importance of interaction evaluations run with the inverse model: the human simulated to evaluate robot behavior, or “Oz of Wizard”. We argue that such studies play an important role in the field of human-robot interaction. We differentiate between methodologically rigorous human modeling and placeholder simulations using simplified human models. Guidelines are proposed for when Oz of Wizard results should be considered acceptable. This paper also describes a framework for describing the various permutations of Wizard and Oz states.

Keywords
Wizard of Oz, human-robot interaction, evaluation, interaction

Notes
Sponsor: National Science Foundation
Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Quality of Life Technology Center
Associated Lab(s) / Group(s): NavLab and Human-Robot Interaction Group
Associated Project(s): Quality of Life Technology and Cyberinfrastructure for Human-Robot Interaction Research

Text Reference
Aaron Steinfeld, Odest Chadwicke Jenkins, and Brian Scassellati, "The Oz of Wizard: Simulating the Human for Interaction Research," ACM/IEEE International Conference on Human-Robot Interaction (HRI), March, 2009.

BibTeX Reference
@inproceedings{Steinfeld_2009_6322,
   author = "Aaron Steinfeld and Odest Chadwicke Jenkins and Brian Scassellati",
   title = "The Oz of Wizard: Simulating the Human for Interaction Research",
   booktitle = "ACM/IEEE International Conference on Human-Robot Interaction (HRI)",
   month = "March",
   year = "2009",
}