State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersections - Robotics Institute Carnegie Mellon University

State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersections

Conference Paper, Proceedings of (IROS) IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 12219 - 12224, October, 2022

Abstract

Traversing intersections is a challenging problem for autonomous vehicles, especially when the intersections do not have traffic control. Recently deep reinforcement learning has received massive attention due to its success in dealing with autonomous driving tasks. In this work, we address the problem of traversing unsignalized intersections using a novel curriculum for deep reinforcement learning. The proposed curriculum leads to: 1) A faster training process for the reinforcement learning agent, and 2) Better performance compared to an agent trained without curriculum. Our main contribution is two-fold: 1) Presenting a unique curriculum for training deep reinforcement learning agents, and 2) showing the application of the proposed curriculum for the unsignalized intersection traversal task. The framework expects processed observations of the surroundings from the perception system of the autonomous vehicle. We test our method in the CommonRoad motion planning simulator on T-intersections and four-way intersections.

BibTeX

@conference{Khaitan-2022-134811,
author = {Shivesh Khaitan and John M. Dolan},
title = {State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersections},
booktitle = {Proceedings of (IROS) IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {2022},
month = {October},
pages = {12219 - 12224},
keywords = {autonomous driving, curriculum learning, reinforcement learning, intersections},
}