Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems

Kristen Stubbs, Debra Bernstein, Kevin Crowley, and Illah Nourbakhsh
Proceedings of the 15th International Symposium on Robot and Human Interactive Communication (RO-MAN 06), September, 2006, pp. 59-65.


Download
  • Adobe portable document format (pdf) (326KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
To help answer questions about the behavior of participants in human-robot systems, we propose the Cognitive Evaluationof Human-Robot Systems (CHERS) method based on our work with the Personal Exploration Rover (PER). The CEHRS method consists of six steps: (1) identify all system participants, (2) collect data from all participant groups, including the system's creators, (3) analyze participant data in light of system-wide goals, (4) answer targeted questions about each participant group to determine the flow of knowledge, information, and influence throughout the system, (5) look for inconsistencies in the knowledge and beliefs of different participant groups, and (5) make recommendations for improvement. We offer this comprehensive, human-centered evaluation method as a starting point for future work in understanding cognitive change in human-robot interactions.

Keywords
human-robot interaction, cognitive change

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Quality of Life Technology Center
Associated Lab(s) / Group(s): Human-Robot Interaction Group
Associated Project(s): Anthropocentric Robotics
Number of pages: 7

Text Reference
Kristen Stubbs, Debra Bernstein, Kevin Crowley, and Illah Nourbakhsh, "Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems," Proceedings of the 15th International Symposium on Robot and Human Interactive Communication (RO-MAN 06), September, 2006, pp. 59-65.

BibTeX Reference
@inproceedings{Stubbs_2006_5695,
   author = "Kristen Stubbs and Debra Bernstein and Kevin Crowley and Illah Nourbakhsh",
   title = "Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems",
   booktitle = "Proceedings of the 15th International Symposium on Robot and Human Interactive Communication (RO-MAN 06)",
   pages = "59-65",
   publisher = "IEEE",
   month = "September",
   year = "2006",
}