Carnegie Mellon University
Value Function Based Production Scheduling

Jeff Schneider , Justin Boyan, and Andrew Moore
Machine Learning: Proceedings of the Fifteenth International Conference (ICML '98), March, 1998.

  • Adobe portable document format (pdf) (144KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Production scheduling, the problem of sequentially configuring a factory to meet forecasted demands, is a critical problem throughout the manufacturing industry. The requirement of maintaining product inventories in the face of unpredictable demand and stochastic factory output makes standard scheduling models, such as job-shop, inadequate. Currently applied algorithms, such as simulated annealing and constraint propagation, must employ ad-hoc methods such as frequent replanning to cope with uncertainty.

In this paper, we describe a Markov Decision Process (MDP) formulation of production scheduling which captures stochasticity in both production and demands. The solution to this MDP is a value function which can be used to generate optimal scheduling decisions online. A simple example illustrates the theoretical superiority of this approach over replanning-based methods. We then describe an industrial application and two reinforcement learning methods for generating an approximate value function on this domain. Our results demonstrate that in both deterministic and noisy scenarios, value function approximation is an effective technique.

Associated Lab(s) / Group(s): Reliable Autonomous Systems Lab and Auton Lab
Associated Project(s): Auton Project and Federation of Intelligent Robotic Explorers Project

Text Reference
Jeff Schneider , Justin Boyan, and Andrew Moore, "Value Function Based Production Scheduling," Machine Learning: Proceedings of the Fifteenth International Conference (ICML '98), March, 1998.

BibTeX Reference
   author = "Jeff {Schneider } and Justin Boyan and Andrew Moore",
   title = "Value Function Based Production Scheduling",
   booktitle = "Machine Learning: Proceedings of the Fifteenth International Conference (ICML '98)",
   month = "March",
   year = "1998",