Using response times to model student disengagement

Joseph E. Beck
Proceedings of the ITS2004 Workshop on Social and Emotional Intelligence in Learning Environments, August, 2004.


Download
  • Adobe portable document format (pdf) (81KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Time on task is an important variable for learning a skill. However, learners must be focused on the learning for the time invested to be productive. Unfortunately, students do not always try their hardest to solve problems presented by computer tutors. This paper explores student disengagement and proposes a model for detecting whether a student is engaged in answering questions. This model is based on item response theory, and uses as input the difficulty of the question, how long the student took to respond, and whether the response was correct. From these data, the model determines the probability a student was actively engaged in trying to answer the question. To validate our model, we analyze 231 students' interactions with the 2002-2003 version of the Reading Tutor. We show that disengagement is better modeled by simultaneously estimating student proficiency and disengagement than just estimating disengagement alone. Our best model of disengagement has a correlation of -0.25 with student learning gains. The novel aspect of this work is that it requires only data normally collected by a computer tutor, and the affective model is validated against student performance on an external measure.

Notes
Associated Lab(s) / Group(s): Project LISTEN
Associated Project(s): Project LISTEN\'s Reading Tutor
Number of pages: 8

Text Reference
Joseph E. Beck, "Using response times to model student disengagement," Proceedings of the ITS2004 Workshop on Social and Emotional Intelligence in Learning Environments, August, 2004.

BibTeX Reference
@inproceedings{Beck_2004_4993,
   author = "Joseph E Beck",
   title = "Using response times to model student disengagement",
   booktitle = "Proceedings of the ITS2004 Workshop on Social and Emotional Intelligence in Learning Environments",
   month = "August",
   year = "2004",
}