Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectories

Zhang Yanfu, Wenshan Wang, Rogerio Bonatti, Daniel Maturana and Sebastian Scherer
Conference Paper, Conference on Robot Learning, October, 2018

View Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Predicting the motion of a mobile agent from a third-person perspective is an important component for many robotics applications, such as autonomous navigation
and tracking. With accurate motion prediction of other agents, robots can plan for more intelligent behaviors to achieve specified objectives, instead of acting
in a purely reactive way. Previous work addresses motion prediction by either only filtering kinematics, or using hand-designed and learned representations of
the environment. Instead of separating kinematic and environmental context, we propose a novel approach to integrate both into an inverse reinforcement learning
(IRL) framework for trajectory prediction. Instead of exponentially increasing the state-space complexity with kinematics, we propose a two-stage neural network
architecture that considers motion and environment together to recover the reward function. The first-stage network learns feature representations of the environment
using low-level LiDAR statistics and the second-stage network combines those learned features with kinematics data. We collected over 30 km of off-road
driving data and validated experimentally that our method can effectively extract useful environmental and kinematic features. We generate accurate predictions of
the distribution of future trajectories of the vehicle, encoding complex behaviors such as multi-modal distributions at road intersections, and even show different
predictions at the same intersection depending on the vehicle’s speed.

author = {Zhang Yanfu and Wenshan Wang and Rogerio Bonatti and Daniel Maturana and Sebastian Scherer},
title = {Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectories},
booktitle = {Conference on Robot Learning},
year = {2018},
month = {October},
publisher = {Journal of Machine Learning Research},
keywords = {Inverse reinforcement learning, motion forecasting, motion planning},
} 2019-02-12T14:44:11-04:00