Carnegie Mellon University
The
Active Comparison Based Learning Incorporating User Uncertainty and Noise

Rachel Holladay , Shervin Javdani, Anca Dragan, and Siddhartha Srinivasa
RSS Workshop on Model Learning for Human-Robot Communication, June, 2016.


Download
  • Adobe portable document format (pdf) (465KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Our goal is to facilitate better human-robot collaboration by enabling robots to learn our preferences. To learn preferences, robots need to interact with users. We propose using comparison based learning, which learns preferences by asking a user to compare several alternatives. To minimize user burden, we use active learning. A challenge of comparison based learning is that it can be difficult for a user to say which item they prefer. Forcing the user to provide a preference in these cases leads to noisy responses, which increases the number of needed queries. Our key insight is that users can identify difficult comparisons and that we can use this information to learning their uncertainty. We present CLAUS (Comparison Learning Algorithm for Uncertain Situations), which model uncertainty and uses it to select and process comparison queries. Our user study suggests that CLAUS uses fewer queries than algorithms which force users to choose, while maintaining nearly the same accuracy.

Keywords
machine learning, active learning, comparison based learning, human robot interaction, preference elicitation

Notes
Associated Center(s) / Consortia: Quality of Life Technology Center, National Robotics Engineering Center, and Center for the Foundations of Robotics
Associated Lab(s) / Group(s): Personal Robotics
Number of pages: 7

Text Reference
Rachel Holladay , Shervin Javdani, Anca Dragan, and Siddhartha Srinivasa, "Active Comparison Based Learning Incorporating User Uncertainty and Noise," RSS Workshop on Model Learning for Human-Robot Communication, June, 2016.

BibTeX Reference
@inproceedings{Holladay__2016_8120,
   author = "Rachel {Holladay } and Shervin Javdani and Anca Dragan and Siddhartha Srinivasa",
   title = "Active Comparison Based Learning Incorporating User Uncertainty and Noise",
   booktitle = "RSS Workshop on Model Learning for Human-Robot Communication",
   month = "June",
   year = "2016",
}