The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Neurophysiological recording experiments in the dopamine system by Schultz and colleagues (Science 275 (1997) 1593}1598) suggest that neurons there are involved in learning to predict rewards and assess behaviors using the temporal-di!erence algorithm. One aspect of this theory which is undeveloped and experimentally underconstrained is its assumption of an exhaustive input representing all stimuli and their history over time. We use the algorithm to model operant choice between concurrent variable interval schedules*a key animal conditioning experiment*and show that animals' subtly suboptimal performance resembles the behavior ofthe algorithm with a more limited input representation. This limitation may re#ect the operation of an attentional mechanism gating the inputs to the dopamine system.

Notes

Number of pages: 7

Text Reference

N. D. Daw and David S. Touretzky, "Operant behavior suggests attentional gating of dopamine system inputs," Neurocomputing, Vol. 38, No. 40, 2001, pp. 1161 - 1167.

BibTeX Reference

@article{Touretzky_2001_3410,
   author = "N. D. Daw and David S Touretzky",
   title = "Operant behavior suggests attentional gating of dopamine system inputs",
   journal = "Neurocomputing",
   pages = "1161 - 1167",
   year = "2001",
   volume = "38",
   number = "40",
}

The Robotics Institute

Menu