A Human-Assisted Approach for a Mobile Robot to Learn 3D Object Models using Active Vision

Matthijs Jan Zwinderman, Paul Rybski, and Gert Kootstra
19th IEEE International Symposium in Robot and Human Interactive Communication (Ro-Man), October, 2010.


Download
  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
In this paper we present an algorithm that allows a human to naturally and easily teach a mobile robot how to recognize objects in its environment. The human selects the object by pointing at it using a laser pointer. The robot recognizes the laser reflections with its cameras and uses this data to generate an initial 2D segmentation of the object. The 3D position of SURF feature points are extracted from the designated area using stereo vision. As the robot moves around the object, new views of the object are obtained from which feature points are extracted. These features are filtered using active vision. The complete object representation consists of feature points registered with 3D pose data. We describe the method and show that it works well by performing experiments on real world data collected with our robot. We use an extensive dataset of 21 objects, differing in size, shape and texture.

Notes
Sponsor: National Science Foundation (NSF)
Associated Center(s) / Consortia: Vision and Autonomous Systems Center and Quality of Life Technology Center
Associated Lab(s) / Group(s): Human-Robot Interaction Group
Associated Project(s): Snackbot
Number of pages: 7

Text Reference
Matthijs Jan Zwinderman, Paul Rybski, and Gert Kootstra, "A Human-Assisted Approach for a Mobile Robot to Learn 3D Object Models using Active Vision," 19th IEEE International Symposium in Robot and Human Interactive Communication (Ro-Man), October, 2010.

BibTeX Reference
@inproceedings{Zwinderman_2010_6656,
   author = "Matthijs Jan Zwinderman and Paul Rybski and Gert Kootstra",
   title = "A Human-Assisted Approach for a Mobile Robot to Learn 3D Object Models using Active Vision",
   booktitle = "19th IEEE International Symposium in Robot and Human Interactive Communication (Ro-Man)",
   month = "October",
   year = "2010",
}