A Lattice-based MRF Model for Dynamic Near-regular Texture Tracking

Wen-Chieh Lin and Yanxi Liu
IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, No. 5, May, 2007, pp. 777 - 792.


Download
  • Adobe portable document format (pdf) (6MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
A near-regular texture (NRT) is a geometric and photometric deformation from its regular origin--a congruent wallpaper pattern formed by 2D translations of a single tile. A dynamic NRT is an NRT under motion. Although NRTs are pervasive in man-made and natural environments, effective computational algorithms for NRTs are few. This paper addresses specific computational challenges in modeling and tracking dynamic NRTs, including ambiguous correspondences, occlusions, and drastic illumination and appearance variations. We propose a lattice-based Markov-Random-Field (MRF) model for dynamic NRTs in a 3D spatiotemporal space. Our model consists of a global lattice structure that characterizes the topological constraint among multiple textons and an image observation model that handles local geometry and appearance variations. Based on the proposed MRF model, we develop a tracking algorithm that utilizes belief propagation and particle filtering to effectively handle the special challenges of the dynamic NRT tracking without any assumption on the motion types or lighting conditions. We provide quantitative evaluations of the proposed method against existing tracking algorithms and demonstrate its applications in video editing.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Computational Symmetry
Associated Project(s): Near Regular Texture -- Analysis, Synthesis and Manipulation
Number of pages: 16
Note: (to appear)

Text Reference
Wen-Chieh Lin and Yanxi Liu, "A Lattice-based MRF Model for Dynamic Near-regular Texture Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, No. 5, May, 2007, pp. 777 - 792.

BibTeX Reference
@article{Lin_2007_5737,
   author = "Wen-Chieh Lin and Yanxi Liu",
   title = "A Lattice-based MRF Model for Dynamic Near-regular Texture Tracking",
   journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
   pages = "777 - 792",
   month = "May",
   year = "2007",
   volume = "29",
   number = "5",
   Notes = "(to appear)"
}