DISC: A Large-scale Virtual Dataset for Simulating Disaster Scenarios

Hae-Gon Jeon, Sunghoon Im, Byeong-Uk Lee, Dong-Geol Choi, Martial Hebert and In So Kweon
Conference Paper, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), November, 2019

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

In this paper, we present the first large-scale synthetic dataset for visual perception in disaster scenarios, and analyze state-of-the-art methods for multiple computer vision tasks with reference baselines. We simulated before and after disaster scenarios such as fire and building collapse for fifteen different locations in realistic virtual worlds. The dataset consists of more than 300K high-resolution stereo image pairs, all annotated with ground-truth data for semantic segmentation, depth, optical flow, surface normal estimation and camera pose estimation. To create realistic disaster scenes, we manually augmented the effects with 3D models using physical-based graphics tools. We use our dataset to train state-of-the-art methods and evaluate how well these methods can recognize the disaster situations and produce reliable results on virtual scenes as well as real-world images. The results obtained from each task are then used as inputs to the proposed visual odometry network for generating 3D maps of buildings on fire. Finally, we discuss challenges for future research.

Notes
Project page: https://sites.google.com/site/hgjeoncv/disc-project-page

@conference{Jeon-2019-116160,
author = {Hae-Gon Jeon and Sunghoon Im and Byeong-Uk Lee and Dong-Geol Choi and Martial Hebert and In So Kweon},
title = {DISC: A Large-scale Virtual Dataset for Simulating Disaster Scenarios},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
year = {2019},
month = {November},
keywords = {Synthetic dataset, visual perception, disaster scenario, visual odometry, deep learning},
} 2019-08-22T14:53:16-04:00