When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens - Robotics Institute Carnegie Mellon University

When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens

John Kominek, Gregory Aist, and Jack Mostow
Conference Paper, Proceedings of AAAI '98 Spring Symposium on Intelligent Environments, pp. 161 - 167, March, 1998

Abstract

Speech offers a powerful avenue between user and computer. However, if the user is not speaking, or is speaking to someone else, what is the computer to make of it? Project LISTEN's Reading Tutor is speech-aware software that strives to teach children to read. Because it is useful to know what the child is doing when reading, we are investigating some potential uses of computer vision. By recording and analyzing video of the Tutor in use, we measured the frequency of events that cannot be detected by speech alone. These include how often the child is visually distracted, and how often the teacher or another student provides assistance. This information helps us assess how vision might enhance the effectiveness of the Reading Tutor.

Notes
Reprinted in Proceedings of the Conference on Automated Learning and Discovery (CONALD98), June 11-13, 1998

BibTeX

@conference{Kominek-1998-14596,
author = {John Kominek and Gregory Aist and Jack Mostow},
title = {When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens},
booktitle = {Proceedings of AAAI '98 Spring Symposium on Intelligent Environments},
year = {1998},
month = {March},
pages = {161 - 167},
}