Recognition of Human Behavior with 9eye Stereo Vision and Data Glove - Robotics Institute Carnegie Mellon University

Recognition of Human Behavior with 9eye Stereo Vision and Data Glove

Koichi Ogawara, Soshi Iba, Hiroshi Kimura, and Katsushi Ikeuchi
Conference Paper, Proceedings of Computer Vision and Image Media, March, 2000

Abstract

When a robot recognizes human behaviour and tries to perform the same behaviour afterward, a human behaviour model which is highly applicable in different environment is required. In this paper, we limits the task field to hand operation and describe a novel method of constructing a behaviour model of hand operation using data-glove and HMM, which abstracts human hand action from four attributes ``which hands'', ``state of grasping'', ``hand motion'' and ``relative position of target objects and hands in 3D space'' along the time series. We also describe a method of performing the same human operation by robot with 9eye stereo vision system and 3D template matching, and finally we show the experimental results using a real robot.

BibTeX

@conference{Ogawara-2000-7985,
author = {Koichi Ogawara and Soshi Iba and Hiroshi Kimura and Katsushi Ikeuchi},
title = {Recognition of Human Behavior with 9eye Stereo Vision and Data Glove},
booktitle = {Proceedings of Computer Vision and Image Media},
year = {2000},
month = {March},
keywords = {Gesture Recognition, Humanoid, Stereo Vision, Skill Modelling},
}