Directing Development Effort with Simulated Students - Robotics Institute Carnegie Mellon University

Directing Development Effort with Simulated Students

Joseph E. Beck
Conference Paper, Proceedings of 6th International Conference on Intelligent Tutoring Systems (ITS '02), June, 2002

Abstract

Our goal is to find a methodology for directing development effort in an intelligent tutoring system (ITS). Given that ITS have several AI reasoning components, as well as content to present, evaluating them is a challenging task. Due to these difficulties, few evaluation studies to measure the impact of individual components have been performed. Our architecture evaluates the efficacy of each component of an ITS and considers the impact of a particular teaching goal when determining whether a particular component needs improving. For our AnimalWatch tutor, we found that for certain goals the tutor itself, rather than its reasoning components, needed improvement. We have found that it is necessary to know what the system's teaching goals are before deciding which component is the limiting factor on performance. [Based on Dr. Beck's research at University of Massachusetts Amherst prior to joining Project LISTEN.]

BibTeX

@conference{Beck-2002-8472,
author = {Joseph E. Beck},
title = {Directing Development Effort with Simulated Students},
booktitle = {Proceedings of 6th International Conference on Intelligent Tutoring Systems (ITS '02)},
year = {2002},
month = {June},
}