Using response times to model student disengagement - Robotics Institute Carnegie Mellon University

Using response times to model student disengagement

Joseph E. Beck
Workshop Paper, ITS '04 Workshop on Social and Emotional Intelligence in Learning Environments, August, 2004

Abstract

Time on task is an important variable for learning a skill. However, learners must be focused on the learning for the time invested to be productive. Unfortunately, students do not always try their hardest to solve problems presented by computer tutors. This paper explores student disengagement and proposes a model for detecting whether a student is engaged in answering questions. This model is based on item response theory, and uses as input the difficulty of the question, how long the student took to respond, and whether the response was correct. From these data, the model determines the probability a student was actively engaged in trying to answer the question. To validate our model, we analyze 231 students' interactions with the 2002-2003 version of the Reading Tutor. We show that disengagement is better modeled by simultaneously estimating student proficiency and disengagement than just estimating disengagement alone. Our best model of disengagement has a correlation of -0.25 with student learning gains. The novel aspect of this work is that it requires only data normally collected by a computer tutor, and the affective model is validated against student performance on an external measure.

BibTeX

@workshop{Beck-2004-9000,
author = {Joseph E. Beck},
title = {Using response times to model student disengagement},
booktitle = {Proceedings of ITS '04 Workshop on Social and Emotional Intelligence in Learning Environments},
year = {2004},
month = {August},
}