A reinforcement learning agent for personalized information filtering - Robotics Institute Carnegie Mellon University

A reinforcement learning agent for personalized information filtering

Young-Woo Seo and Byoung-Tak Zhang
Conference Paper, Proceedings of 5th International Conference on Intelligent User Interfaces (IUI '00), pp. 248 - 251, 2000

Abstract

This paper describes a method for learning user's interests in the Web-based personalized information filtering system called WAIR. The proposed method analyzes user's reactions to the presented documents and learns from them the profiles for the individual users. Reinforcement learning is used to adapt the term weights in the user profile so that user's preferences are best represented. In contrast to conventional relevance feedback methods which require explicit user feedbacks, our approach learns user preferences implicitly from direct observations of user behaviors during interaction. Field tests have been made which involved 7 users reading a total of 7,700 HTML documents during 4 weeks. The proposed method showed superior performance in personalized information filtering compared to the existing relevance feedback methods.

BibTeX

@conference{Seo-2000-16758,
author = {Young-Woo Seo and Byoung-Tak Zhang},
title = {A reinforcement learning agent for personalized information filtering},
booktitle = {Proceedings of 5th International Conference on Intelligent User Interfaces (IUI '00)},
year = {2000},
month = {January},
pages = {248 - 251},
}