Meticulously detailed eye model and its application to analysis of facial image

Tsuyoshi Moriyama, Jing Xiao, Jeffrey Cohn, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, May, 2006, pp. 738 - 752.


Download
  • Adobe portable document format (pdf) (6MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
We propose a system that is capable of detailed analysis of eye region images in terms of the position of the iris, degree of eyelid opening, and the shape, complexity, and texture of the eyelids. The system uses a generative eye region model that parameterizes the fine structure and motion of an eye. The structure parameters represent structural individuality of the eye, including the size and color of the iris, the width, boldness, and complexity of the eyelids, the width of the bulge below the eye, and the width of the illumination reflection on the bulge. The motion parameters represent movement of the eye, including the up-down position of the upper and lower eyelids and the 2D position of the iris. The system first registers the eye model to the input in a particular frame and individualizes it by adjusting the structure parameters. The system then tracks motion of the eye by estimating the motion parameters across the entire image sequence. Combined with image stabilization to compensate for appearance changes due to head motion, the system achieves accurate registration and motion recovery of eyes.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Lab(s) / Group(s): Face Group and Component Analysis
Associated Project(s): Facial Expression Analysis
Number of pages: 15

Text Reference
Tsuyoshi Moriyama, Jing Xiao, Jeffrey Cohn, and Takeo Kanade, "Meticulously detailed eye model and its application to analysis of facial image," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, May, 2006, pp. 738 - 752.

BibTeX Reference
@article{Moriyama_2006_5385,
   author = "Tsuyoshi Moriyama and Jing Xiao and Jeffrey Cohn and Takeo Kanade",
   title = "Meticulously detailed eye model and its application to analysis of facial image",
   journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
   pages = "738 - 752",
   month = "May",
   year = "2006",
   volume = "28",
   number = "5",
}