Automated Comprehension Assessment in a Reading Tutor

Jack Mostow, Brian Tobin, and Andrew Cuneo
ITS 2002 Workshop on Creating Valid Diagnostic Assessments, June, 2002.


Download
  • Adobe portable document format (pdf) (233KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Can vocabulary and comprehension assessments be generated automatically for a given text? We describe the automated method used to generate, administer, and score multiple-choice vocabulary and comprehension questions in the 2001-2002 version of Project LISTEN's Reading Tutor. To validate the method against the Woodcock Reading Mastery Test, we analyzed 69,326 multiple-choice cloze items generated in the course of regular Reading Tutor use by 364 students in grades 1-9 at seven schools. Correlation between predicted and actual scores reached R=.85 for Word and Passage Comprehension.

Notes
Associated Lab(s) / Group(s): Project LISTEN
Associated Project(s): Project LISTEN\'s Reading Tutor

Text Reference
Jack Mostow, Brian Tobin, and Andrew Cuneo, "Automated Comprehension Assessment in a Reading Tutor," ITS 2002 Workshop on Creating Valid Diagnostic Assessments, June, 2002.

BibTeX Reference
@inproceedings{Mostow_2002_4075,
   author = "Jack Mostow and Brian Tobin and Andrew Cuneo",
   title = "Automated Comprehension Assessment in a Reading Tutor",
   booktitle = "ITS 2002 Workshop on Creating Valid Diagnostic Assessments",
   month = "June",
   year = "2002",
}