Movie of drivers head from interior camera
Corresponding movie of external scene
Graphics enhanced version of this site
Gaze Estimation
This project is no longer active.
Head: Simon Baker
Contact: Simon Baker
Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213
Associated center: VASC
Associated labs/groups: Vision for Safe Driving and Face Group
Passive gaze estimation is usually performed by locating the pupils, and the inner and outer eye corners in the image of the driver's head. Of these feature points, the eye corners are just as important, and perhaps harder to detect, than the pupils. The eye corners are usually found using local feature detectors and trackers. On the other hand, we have built a passive gaze tracking system which uses a global head model, specifically an Active Appearance Model (AAM), to track the whole head. From the AAM, the eye corners, eye region, and head pose are robustly extracted and then used to estimate the gaze. See here for more details of our AAM tracking algorithms. See the movies below for examples of our results.
Movie of drivers head from interior camera | Corresponding movie of external scene |
Note: This list may not be comprehensive. It contains only those publications in the RI publications database. Entries are listed in reverse chronological order.