Learning Object-specific Grasp Affordance Densities

Renaud Detry, Emre Baseski, Mila Popovic , Younes Touati, Norbert Kruger, Oliver Kroemer, Jan Peters and Justus Piater
Conference Paper, International Conference on Development and Learning (ICDL), January, 2009

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

This paper addresses the issue of learning and representing object grasp affordances, i.e. object-gripper relative configurations that lead to successful grasps. The purpose of grasp affordances is to organize and store the whole knowledge that an agent has about the grasping of an object, in order to facilitate reasoning on grasping solutions and their achievability. The affordance representation consists in a continuous probability density function defined on the 6D gripper pose space – 3D position and orientation –, within an object-relative reference frame. Grasp affordances are initially learned from various sources, e.g. from imitation or from visual cues, leading to grasp hypothesis densities. Grasp densities are attached to a learned 3D visual object model, and pose estimation of the visual model allows a robotic agent to execute samples from a grasp hypothesis density under various object poses. Grasp outcomes are used to learn grasp empirical densities, i.e. grasps that have been confirmed through experience. We show the result of learning grasp hypothesis densities from both imitation and visual cues, and present grasp empirical densities learned from physical experience by a robot.


@conference{Detry-2009-112248,
author = {Renaud Detry and Emre Baseski and Mila Popovic and Younes Touati and Norbert Kruger and Oliver Kroemer and Jan Peters and Justus Piater},
title = {Learning Object-specific Grasp Affordance Densities},
booktitle = {International Conference on Development and Learning (ICDL)},
year = {2009},
month = {January},
} 2019-03-12T13:47:15-04:00