Automatic Learning of Appearance Face Models

Abstract

This paper describes a robust algorithm for automatically learning an appearance subspace of objects performing rigid motion through an image sequence, given a manual initialization of the regions of support (masks) in the first frame. The learning process is posed as a continuous optimization problem and it is solved with a mixture of stochastic and deterministic techniques achieving sub-pixel accuracy. Additionally, we learn the dynamics of the motion and appearance parameters for scene characterization and point out the benefits of working with modular eigenspaces. Preliminary results of automatic learning a modular eigenface model with applications to real time video conferencing, human computer interaction and actor animation are reported.