Survey measures for evaluation of cognitive assistants

Aaron Steinfeld, Pablo-Alejandro Quinones, John Zimmerman, S. Rachael Bennett, and Daniel Siewiorek
NIST Performance Metrics for Intelligent Systems Workshop (PerMIS), 2007.


Download
  • Adobe portable document format (pdf) (458KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
A survey designed to measure subject perception of benefit, ease of use, usefulness, collaboration, disorientation, flow, and assistance was used to evaluate two releases of an integrated machine learning cognitive assistance system. The design and validity of this evaluation survey is discussed in the context of an information overload experiment.

Notes
Sponsor: Defense Advanced Research Projects Agency (DARPA)
Grant ID: Contract No. NBCHD030010
Associated Center(s) / Consortia: Vision and Autonomous Systems Center, Quality of Life Technology Center, and Center for Integrated Manfacturing Decision Systems
Associated Lab(s) / Group(s): Intelligent Coordination and Logistics Laboratory and Human-Robot Interaction Group
Associated Project(s): Reflective Agents with Distributed Adaptive Reasoning
Number of pages: 5

Text Reference
Aaron Steinfeld, Pablo-Alejandro Quinones, John Zimmerman, S. Rachael Bennett, and Daniel Siewiorek, "Survey measures for evaluation of cognitive assistants," NIST Performance Metrics for Intelligent Systems Workshop (PerMIS), 2007.

BibTeX Reference
@inproceedings{Steinfeld_2007_5839,
   author = "Aaron Steinfeld and Pablo-Alejandro Quinones and John Zimmerman and S. Rachael Bennett and Daniel Siewiorek",
   title = "Survey measures for evaluation of cognitive assistants",
   booktitle = "NIST Performance Metrics for Intelligent Systems Workshop (PerMIS)",
   year = "2007",
}