3D Shape Completion and Canonical Pose Estimation with Structured Neural Networks

Wentao Yuan
Master's Thesis, Tech. Report, CMU-RI-TR-19-22, May, 2019

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


3D point cloud is an efficient and flexible representation of 3D structures and the raw output of many 3D sensors. Recently, neural networks operating on point clouds have shown superior performance on various 3D understanding tasks, thanks to their power to extract task-specific semantic features directly from points. In this thesis, we study how to incorporate geometric and algorithmic structures into the design of neural networks in order to achieve more effective and efficient learning from raw point clouds. In particular, we investigate two problems – 3D shape completion and canonical pose estimation – that address two essential characteristics of 3D data in the wild: incompleteness and misalignment. We show that the structured neural networks we propose outperform alternative approaches that do not incorporate structural priors on synthetic benchmarks and demonstrate the potential of our networks to operate on challenging real world data such as LiDAR scans collected from an autonomous vehicle.

author = {Wentao Yuan},
title = {3D Shape Completion and Canonical Pose Estimation with Structured Neural Networks},
year = {2019},
month = {May},
school = {},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-19-22},
keywords = {3D Point Cloud, Deep Learning, Shape Completion, Pose Estimation},
} 2019-05-14T14:43:00-04:00