Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection - Robotics Institute Carnegie Mellon University

Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection

Conference Paper, Proceedings of (ICCV) International Conference on Computer Vision, pp. 1310 - 1319, October, 2017

Abstract

A major impediment in rapidly deploying object detection models for instance detection is the lack of large annotated datasets. For example, finding a large labeled dataset containing instances in a particular kitchen is unlikely. Each new environment with new instances requires expensive data collection and annotation. In this paper, we propose a simple approach to generate large annotated instance datasets with minimal effort. Our key insight is that ensuring only patch-level realism provides enough training signal for current object detector models. We automatically `cut' object instances and `paste' them on random backgrounds. A naive way to do this results in pixel artifacts which result in poor performance for trained models. We show how to make detectors ignore these artifacts during training and generate data that gives competitive performance on real data. Our method outperforms existing synthesis approaches and when combined with real images improves relative performance by more than 21%on benchmark datasets. In a cross-domain setting, our synthetic data combined with just 10% real data outperforms models trained on all real data.

Notes
Associated Lab - Vision and Mobile Robotics Lab, Associated Center - Vision and Autonomous Systems Center (VASC)

BibTeX

@conference{Misra-2017-103478,
author = {Debidatta Dwibedi and Ishan Misra and Martial Hebert},
title = {Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection},
booktitle = {Proceedings of (ICCV) International Conference on Computer Vision},
year = {2017},
month = {October},
pages = {1310 - 1319},
keywords = {computer vision, object detection, image synthesis, instance detection},
}