Learning Selectively Conditioned Forest Structures with Applications to DBNs and Classification

Brian D. Ziebart, Anind Dey, and J. Andrew (Drew) Bagnell
Proceedings of Uncertainty in Artificial Intelligence (UAI 2007), July, 2007.


Download
  • Adobe portable document format (pdf) (340KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Dealing with uncertainty in Bayesian Net?ork structures using maximum a posteriori (MAP) estimation or Bayesian Model Av?raging (BMA) is often intractable due to the superexponential number of possible di?ected, acyclic graphs. When the prior is decomposable, two classes of graphs where efficient learning can take place are tree-?tructures, and fixed?orderings with limited in?degree. We show how MAP estimates and BMA for selectively conditioned forests (SCF), a combination of these two classes, can be computed efficiently for ordered sets of variables. We apply SCFs to temporal data to learn Dynamic Bayesian Networks having an intra-?imestep forest and inter-?imestep limited in-?egree structure, improving model accuracy over DBNs without the combination of structures. We also apply SCFs to Bayes Net classification to learn selective forest?augmented Naive Bayes classifiers. We ar?ue that the built-?n feature selection of selec?ive augmented Bayes classifiers makes them preferable to similar non?selective classifiers based on empirical evidence.

Keywords
Bayesian Networks, structure learning, augmented naive Bayes

Notes

Text Reference
Brian D. Ziebart, Anind Dey, and J. Andrew (Drew) Bagnell, "Learning Selectively Conditioned Forest Structures with Applications to DBNs and Classification," Proceedings of Uncertainty in Artificial Intelligence (UAI 2007), July, 2007.

BibTeX Reference
@inproceedings{Ziebart_2007_5908,
   author = "Brian D. Ziebart and Anind Dey and J. Andrew (Drew) Bagnell",
   title = "Learning Selectively Conditioned Forest Structures with Applications to DBNs and Classification",
   booktitle = "Proceedings of Uncertainty in Artificial Intelligence (UAI 2007)",
   month = "July",
   year = "2007",
}