The Robotics Institute
Search the site
RI | Publications | Survey measures for evaluation of cognitive assistants

Text only version of this site

Survey measures for evaluation of cognitive assistants
A. Steinfeld, P. Quinones, J. Zimmerman, S.R. Bennett, and D. Siewiorek
NIST Performance Metrics for Intelligent Systems Workshop (PerMIS), 2007.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Download [Help]

Adobe portable document format (pdf) [457 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

A survey designed to measure subject perception of benefit, ease of use, usefulness, collaboration, disorientation, flow, and assistance was used to evaluate two releases of an integrated machine learning cognitive assistance system. The design and validity of this evaluation survey is discussed in the context of an information overload experiment.

Notes

Sponsor: Defense Advanced Research Projects Agency (DARPA)
Grant ID: Contract No. NBCHD030010

Associated centers: VASC, CIMDS, MRTC, SRI, and FRC
Associated labs/groups: Human-Robot Interaction Group and Intelligent Coordination and Logistics Laboratory
Associated project: Reflective Agents with Distributed Adaptive Reasoning

Number of pages: 5

Text Reference

A. Steinfeld, P. Quinones, J. Zimmerman, S.R. Bennett, and D. Siewiorek, "Survey measures for evaluation of cognitive assistants," NIST Performance Metrics for Intelligent Systems Workshop (PerMIS), 2007.

BibTeX Reference

@inproceedings{Steinfeld_2007_5839,
   author = "Aaron Steinfeld and Pablo-Alejandro Quinones and John Zimmerman and S. Rachael Bennett and Daniel Siewiorek",
   title = "Survey measures for evaluation of cognitive assistants",
   booktitle = "NIST Performance Metrics for Intelligent Systems Workshop (PerMIS)",
   year = "2007"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu