Home/Real-Time Semantic Mapping for Autonomous Off-Road Navigation

Real-Time Semantic Mapping for Autonomous Off-Road Navigation

Daniel Maturana, Po-Wei Chou, Masashi Uenoyama and Sebastian Scherer
Book Section/Chapter, In Field and Service Robotics, Springer Proceedings in Advanced Robotics, Vol. 5, pp. 335–350, January, 2018

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


In this paper we describe a semantic mapping system for autonomous off-road driving with an All-Terrain Vehicle (ATVs). The system’s goal is to provide a richer representation of the environment than a purely geometric map, allowing it to distinguish, e.g., tall grass from obstacles. The system builds a 2.5D grid map encoding both geometric (terrain height) and semantic information (navigation-relevant classes such as trail, grass, etc.). The geometric and semantic information are estimated online and in real-time from LiDAR and image sensor data, respectively. Using this semantic map, motion planners can create semantically aware trajectories. To achieve robust and efficient semantic segmentation, we design a custom Convolutional Neural Network (CNN) and train it with a novel dataset of labelled off-road imagery built for this purpose. We evaluate our semantic segmentation offline, showing comparable performance to the state of the art with slightly lower latency. We also show closed-loop field results with an autonomous ATV driving over challenging off-road terrain by using the semantic map in conjunction with a simple path planner. Our models and labelled dataset will be publicly available at http://dimatura.net/offroad.

author = {Daniel Maturana and Po-Wei Chou and Masashi Uenoyama and Sebastian Scherer},
title = {Real-Time Semantic Mapping for Autonomous Off-Road Navigation},
booktitle = {In Field and Service Robotics, Springer Proceedings in Advanced Robotics},
publisher = {Springer},
year = {2018},
month = {January},
pages = {335–350},
volume = {5},
} 2018-10-04T10:33:23-04:00