Just Go With the Flow: Self-Supervised Scene Flow Estimation - Robotics Institute Carnegie Mellon University

Just Go With the Flow: Self-Supervised Scene Flow Estimation

Himangi Mittal, Brian Okorn, and David Held
Conference Paper, Proceedings of (CVPR) Computer Vision and Pattern Recognition, pp. 11174 - 11182, June, 2020

Abstract

When interacting with highly dynamic environments, scene flow allows autonomous systems to reason about the non-rigid motion of multiple independent objects. This is of particular interest in the field of autonomous driving, in which many cars, people, bicycles, and other objects need to be accurately tracked. Current state-of-the-art methods require annotated scene flow data from autonomous driving scenes to train scene flow networks with supervised learning. As an alternative, we present a method of training scene flow that uses two self-supervised losses, based on nearest neighbors and cycle consistency. These self-supervised losses allow us to train our method on large unlabeled autonomous driving datasets; the resulting method matches current state-of-the-art supervised performance using no real world annotations and exceeds state-of-the-art performance when combining our self-supervised approach with supervised learning on a smaller labeled dataset.

BibTeX

@conference{Mittal-2020-122637,
author = {Himangi Mittal and Brian Okorn and David Held},
title = {Just Go With the Flow: Self-Supervised Scene Flow Estimation},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2020},
month = {June},
pages = {11174 - 11182},
keywords = {Scene Flow, Self-Supervised, Point Clouds, KITTI, nuScenes, Autonomous Driving},
}