The Robotics Institute

Carnegie Mellon Robotics Institute

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We present a new method of sensing the 3D visual environment and controlling objects within it. The human hand is well suited to interrogate and manipulate objects by physical contact; however, the hand is limited to surfaces within its reach. Extending the hand? innate ability, we mount miniature cameras on individual fingertips, permitting rapid sweeping through the 3D visual environment at greater distances. The information gleaned from each fingertip camera is fed back to that finger by a small vibrator, so the sense of touch remains related to each finger? individual interaction with the environment. The muscles of the fingers, wrist, and arm can potentially provide motor control as fine as the eyes?(and we have ten fingers instead of only two eyes) although the sensory resolution and total bandwidth is likely to be less. Metaphorically speaking, we have given eyesight to the fingers, and thus we call the resulting capability, ?ingersightTM.?In addition to sensing the environment, we can remotely control certain identified targets with subsequent motion of the fingers. We can move or rotate objects on a computer screen or recognize inanimate objects such as a light switch, controlling environmental parameters with a flick of the finger.

Notes

Associated Lab(s) / Group(s): Visualization and Image Analysis

Associated Project(s): Fingersight

Number of pages: 4

Text Reference

George D. Stetten, Roberta Klatzky, B. Nichol, John Galeotti, K. Rockot, K. Zawrotny, D. Weiser, N. Sendgikoski, and , "Fingersight: Fingertip Visual Haptic Sensing and Control," IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2007), October, 2007.

BibTeX Reference

@inproceedings{Stetten_2007_5886,
   author = "George D Stetten and Roberta Klatzky and B. Nichol and John Galeotti and K. Rockot and K. Zawrotny and D. Weiser and N. Sendgikoski and ",
   title = "Fingersight: Fingertip Visual Haptic Sensing and Control",
   booktitle = "IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2007)",
   month = "October",
   year = "2007",
}

The Robotics Institute

Menu