Recognition of human behaviour using stereo vision and data gloves

Abstract

This paper presents a novel method of constructing a human behaviour model by attention point (AP) analysis. The AP analysis consists of two steps. At the first step, it broadly observes human behaviour, constructs rough human behaviour model and finds APs which require detailed analysis. Then at the second step, by applying time-consuming analysis on APs in the same human behaviour, it can enhance the human behaviour model. This human behaviour model is highly abstracted and is able to change the degree of abstraction adapting to the environment so as to be applicable in a different environment. We describe this method and its implementation using data gloves and a stereo vision system. We also show an experimental result in which a real robot observed and performed the same human behaviour successfully in a different environment using this model