Home/Speech and gaze conflicts in collaborative human-robot interactions

Speech and gaze conflicts in collaborative human-robot interactions

Henny Admoni, Christopher Datsikas and Brian Scassellati
Conference Paper, Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci 2014), Vol. 36, pp. 104 - 109, July, 2014

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Gaze and speech are both important modes of communicationfor human-robot interactions. However, few studies to datehave explored the effects of conflict in a robot’s multi-modalcommunication. In this paper, we investigate how such speech-gaze conflicts affect performance on a cooperative referentialtask. Participants play a selection game with a robot, in whichthe robot instructs them to select one object from among agroup of available objects. We vary whether the robot’s gazeis congruent with its speech, incongruent with its speech, orabsent, and we measure participants’ response times to therobot’s instructions. Results indicate that congruent speechfacilitates performance but that incongruent speech does nothinder performance. We repeat the study with a human actorinstead of a robot to investigate whether human gaze has thesame effect, and find the same results: in this type of activ-ity, congruent gaze helps performance while incongruent gazedoes not hurt it. We conclude that robot gaze may be a worth-while investment in such situations, even when gaze behaviorsmay be unreliable.

author = {Henny Admoni and Christopher Datsikas and Brian Scassellati},
title = {Speech and gaze conflicts in collaborative human-robot interactions},
booktitle = {Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci 2014)},
year = {2014},
month = {July},
volume = {36},
pages = {104 - 109},
} 2019-05-23T14:31:25-04:00