The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Speech offers a powerful avenue between user and computer. However, if the user is not speaking, or is speaking to someone else, what is the computer to make of it? Project LISTEN's Reading Tutor is speech-aware software that strives to teach children to read. Because it is useful to know what the child is doing when reading, we are investigating some potential uses of computer vision. By recording and analyzing video of the Tutor in use, we measured the frequency of events that cannot be detected by speech alone. These include how often the child is visually distracted, and how often the teacher or another student provides assistance. This information helps us assess how vision might enhance the effectiveness of the Reading Tutor.

Notes

Associated Lab(s) / Group(s): Project LISTEN

Associated Project(s): Project LISTEN's Reading Tutor

Note: Reprinted in Proceedings of the Conference on Automated Learning and Discovery (CONALD98), June 11-13, 1998

Text Reference

John Kominek, Gregory Aist, and Jack Mostow, "When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens.," AAAI Spring Symposium on Intelligent Environments, March, 1998.

BibTeX Reference

@inproceedings{Kominek_1998_3691,
   author = "John Kominek and Gregory Aist and Jack Mostow",
   title = "When Listening Is Not Enough: Potential Uses of Vision for a Reading Tutor that Listens.",
   booktitle = "AAAI Spring Symposium on Intelligent Environments",
   month = "March",
   year = "1998",
   Notes = "Reprinted in Proceedings of the Conference on Automated Learning and Discovery (CONALD98), June 11-13, 1998"
}

The Robotics Institute

Menu