/An efficient global energy optimization approach for robust 3D plane segmentation of point clouds

An efficient global energy optimization approach for robust 3D plane segmentation of point clouds

Zhen Dong, Bisheng Yanga, Pingbo Hua and Sebastian Scherer
Journal Article, ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 137, pp. 112-133, March, 2018

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


Automatic 3D plane segmentation is necessary for many applications including point cloud registration, building information model (BIM) reconstruction, simultaneous localization and mapping (SLAM), and point cloud compression. However, most of the existing 3D plane segmentation methods still suffer from low precision and recall, and inaccurate and incomplete boundaries, especially for low-quality point clouds collected by RGB-D sensors. To overcome these challenges, this paper formulates the plane segmentation problem as a global energy optimization because it is robust to high levels of noise and clutter. First, the proposed method divides the raw point cloud into multiscale supervoxels, and considers planar supervoxels and individual points corresponding to nonplanar supervoxels as basic units. Then, an efficient hybrid region growing algorithm is utilized to generate initial plane set by incrementally merging adjacent basic units with similar features. Next, the initial plane set is further enriched and refined in a mutually reinforcing manner under the framework of global energy optimization. Finally, the performances of the proposed method are evaluated with respect to six metrics (i.e., plane precision, plane recall, under-segmentation rate, over-segmentation rate, boundary precision, and boundary recall) on two benchmark datasets. Comprehensive experiments demonstrate that the proposed method obtained good performances both in high-quality TLS point clouds (i.e., SEMANTIC3D.NET dataset) and low-quality RGB-D point clouds (i.e., S3DIS dataset) with six metrics of (94.2%, 95.1%, 2.9%, 3.8%, 93.6%, 94.1%) and (90.4%, 91.4%, 8.2%, 7.6%, 90.8%, 91.7%) respectively.

BibTeX Reference
author = {Zhen Dong and Bisheng Yanga and Pingbo Hua and Sebastian Scherer},
title = {An efficient global energy optimization approach for robust 3D plane segmentation of point clouds},
journal = {ISPRS Journal of Photogrammetry and Remote Sensing},
year = {2018},
month = {March},
volume = {137},
pages = {112-133},
keywords = {Plane segmentation; Multiscale supervoxel; Hybrid region growing; Energy optimization; Simulated annealing; Guided sampling},