Home/Exploiting Inference for Approximate Parameter Learning in Discriminative Fields: An Empirical Study

Exploiting Inference for Approximate Parameter Learning in Discriminative Fields: An Empirical Study

Sanjiv Kumar, Jonas August and Martial Hebert
Conference Paper, Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR), January, 2005

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Estimation of parameters of random field models from la- beled training data is crucial for their good performance in many im- age analysis applications. In this paper, we present an approach for ap- proximate maximum likelihood parameter learning in discriminative field models, which is based on approximating true expectations with simple piecewise constant functions constructed using inference techniques. Gra- dient ascent with these updates exhibits compelling limit cycle behavior which is tied closely to the number of errors made during inference. The performance of various approximations was evaluated with different in- ference techniques showing that the learned parameters lead to good classification performance so long as the method used for approximating the gradient is consistent with the inference mechanism. The proposed approach is general enough to be used for the training of, e.g., smoothing parameters of conventional Markov Random Fields (MRFs).

BibTeX Reference
@conference{Kumar-2005-16973,
title = {Exploiting Inference for Approximate Parameter Learning in Discriminative Fields: An Empirical Study},
author = {Sanjiv Kumar and Jonas August and Martial Hebert},
booktitle = {Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR)},
month = {January},
year = {2005},
}
2017-09-13T10:43:36+00:00