The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Vision-based prop-free pointing detection is challenging both from an algorithmic and a systems standpoint. From a computer vision perspective, accurately determining where multiple users are pointing is difficult in cluttered environments with dynamic scene content. Standard approaches relying on appearance models or background subtraction to segment users operate poorly in this domain. We propose a method that focuses on motion analysis to detect pointing gestures and robustly estimate the pointing direction. Our algorithm is self-initializing; as the user points, we analyze the observed motion from two cameras and infer rotation centers that best explain the observed motion. From these, we group pixel-level flow into dominant pointing vectors that each originate from a rotation center and merge across views to obtain 3D pointing vectors. However, our proposed algorithm is computationally expensive, posing systems challenges even with current computing infrastructure. We achieve interactive speeds by exploiting coarse-grained parallelization over a cluster of computers. In unconstrained environments, we obtain an average angular precision of 2.7.

Notes

Text Reference

Pyry Matikainen, Padmanabhan Pillai, Lily Mummert, Rahul Sukthankar, and Martial Hebert, "Prop-Free Pointing Detection in Dynamic Cluttered Environments," Proceedings of International Conference on Automatic Face and Gesture Recognition, 2011, March, 2011.

BibTeX Reference

@inproceedings{Matikainen_2011_6826,
   author = "Pyry Matikainen and Padmanabhan Pillai and Lily Mummert and Rahul Sukthankar and Martial Hebert",
   title = "Prop-Free Pointing Detection in Dynamic Cluttered Environments",
   booktitle = "Proceedings of International Conference on Automatic Face and Gesture Recognition, 2011",
   month = "March",
   year = "2011",
}

The Robotics Institute

Menu