The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Can vocabulary and comprehension assessments be generated automatically for a given text? We describe the automated method used to generate, administer, and score multiple-choice vocabulary and comprehension questions in the 2001-2002 version of Project LISTEN's Reading Tutor. To validate the method against the Woodcock Reading Mastery Test, we analyzed 69,326 multiple-choice cloze items generated in the course of regular Reading Tutor use by 364 students in grades 1-9 at seven schools. Correlation between predicted and actual scores reached R=.85 for Word and Passage Comprehension.

Notes

Associated Lab(s) / Group(s): Project LISTEN

Associated Project(s): Project LISTEN's Reading Tutor

Text Reference

Jack Mostow, Brian Tobin, and Andrew Cuneo, "Automated Comprehension Assessment in a Reading Tutor," ITS 2002 Workshop on Creating Valid Diagnostic Assessments, June, 2002.

BibTeX Reference

@inproceedings{Mostow_2002_4075,
   author = "Jack Mostow and Brian Tobin and Andrew Cuneo",
   title = "Automated Comprehension Assessment in a Reading Tutor",
   booktitle = "ITS 2002 Workshop on Creating Valid Diagnostic Assessments",
   month = "June",
   year = "2002",
}

The Robotics Institute

Menu