Generalizable Learning-based Registration

Hunter Goforth
Master's Thesis, Tech. Report, CMU-RI-TR-19-38, June, 2019

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


This thesis explores the application of deep learning algorithms to 2D (image) and 3D (point cloud) registration scenarios, especially where the challenging nature of the data precludes the use of classical methods for establishing correspondence and alignment.

In the 2D case, we apply a recently-proposed learning-based image registration method to the problem of aligning outdoor imagery taken across seasons and times of day. Further, we extend the method to perform GPS-denied UAV geolocalization by aligning UAV images and satellite imagery. We also propose a novel joint optimization of motion estimates from visual odometry and geolocalization, to increase localization accuracy in cases where parts of the satellite map may be missing or too dissimilar from the UAV imagery.

In the 3D case, we develop three novel point cloud registration algorithms based on state-of-the-art point cloud processing deep networks. We show the benefits of the learned representation for registration on partial data, intra-category data (same category, different shape), and real-world data.

author = {Hunter Goforth},
title = {Generalizable Learning-based Registration},
year = {2019},
month = {June},
school = {},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-19-38},
keywords = {image registration, point cloud registration, deep neural networks, lucas kanade},
} 2019-06-11T07:51:06-04:00