Graphics enhanced version of this site

Meticulously detailed eye model and its application to analysis of facial image
T. Moriyama, J. Xiao, J. Cohn, and T. Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, May, 2006, pp. 738 - 752.

Jump to: Download | Abstract | Notes | Text Reference | BibTeX Reference

Adobe portable document format (pdf) [6185 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

We propose a system that is capable of detailed analysis of eye region images in terms of the position of the iris, degree of eyelid opening, and the shape, complexity, and texture of the eyelids. The system uses a generative eye region model that parameterizes the fine structure and motion of an eye. The structure parameters represent structural individuality of the eye, including the size and color of the iris, the width, boldness, and complexity of the eyelids, the width of the bulge below the eye, and the width of the illumination reflection on the bulge. The motion parameters represent movement of the eye, including the up-down position of the upper and lower eyelids and the 2D position of the iris. The system first registers the eye model to the input in a particular frame and individualizes it by adjusting the structure parameters. The system then tracks motion of the eye by estimating the motion parameters across the entire image sequence. Combined with image stabilization to compensate for appearance changes due to head motion, the system achieves accurate registration and motion recovery of eyes.

Associated center: VASC
Associated lab/group: Face Group
Associated project: Facial Expression Analysis

Number of pages: 15

T. Moriyama, J. Xiao, J. Cohn, and T. Kanade, "Meticulously detailed eye model and its application to analysis of facial image," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, May, 2006, pp. 738 - 752.

@article{Moriyama_2006_5385,
   author = "Tsuyoshi Moriyama and Jing Xiao and Jeffrey Cohn and Takeo Kanade",
   title = "Meticulously detailed eye model and its application to analysis of facial image",
   journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",
   month = "May",
   year = "2006",
   volume = "28",
   number = "5",
   pages = "738 - 752"
}