When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens.

John Kominek, Gregory Aist, and Jack Mostow
AAAI Spring Symposium on Intelligent Environments, March, 1998.


Download
  • Adobe portable document format (pdf) (93KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Speech offers a powerful avenue between user and computer. However, if the user is not speaking, or is speaking to someone else, what is the computer to make of it? Project LISTEN's Reading Tutor is speech-aware software that strives to teach children to read. Because it is useful to know what the child is doing when reading, we are investigating some potential uses of computer vision. By recording and analyzing video of the Tutor in use, we measured the frequency of events that cannot be detected by speech alone. These include how often the child is visually distracted, and how often the teacher or another student provides assistance. This information helps us assess how vision might enhance the effectiveness of the Reading Tutor.

Notes
Associated Lab(s) / Group(s): Project LISTEN
Associated Project(s): Project LISTEN\'s Reading Tutor
Note: Reprinted in Proceedings of the Conference on Automated Learning and Discovery (CONALD98), June 11-13, 1998

Text Reference
John Kominek, Gregory Aist, and Jack Mostow, "When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens.," AAAI Spring Symposium on Intelligent Environments, March, 1998.

BibTeX Reference
@inproceedings{Kominek_1998_3691,
   author = "John Kominek and Gregory Aist and Jack Mostow",
   title = "When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens.",
   booktitle = "AAAI Spring Symposium on Intelligent Environments",
   month = "March",
   year = "1998",
   Notes = "Reprinted in Proceedings of the Conference on Automated Learning and Discovery (CONALD98), June 11-13, 1998"
}