Recognizing Tiny Faces

Siva Chaitanya Mynepalli
Master's Thesis, Tech. Report, CMU-RI-TR-19-72, August, 2019

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Objects are naturally captured over a continuous range of distances, causing dramatic changes in appearance, especially at low resolutions. Recognizing such small objects at range is an open challenge in object recognition. In this paper, we explore solutions to this problem by tackling the fine-grained task of face recognition. State-of-the-art embeddings aim to be scale-invariant by extracting representations in a canonical coordinate frame (by resizing a face window to a resolution of say, 224×224 pixels). However, it is well known in the psychophysics literature that human vision is decidedly scale variant: humans are much less accurate at lower resolutions. Motivated by this, we explore scale-variant multiresolution embeddings that explicitly isentangle factors of variation across resolution and scale. Importantly, multiresolution embeddings can adapt in size and complexity to the resolution of input image on-the-fly (e.g., high resolution input images produce more detailed representations that result in better recognition performance). Compared to state-of-the-art ”one-size-fits-all” approaches, our embeddings dramatically reduce error for small faces by at least 70% on standard benchmarks (i.e. IJBC, LFW and MegaFace).


@mastersthesis{Mynepalli-2019-117203,
author = {Siva Chaitanya Mynepalli},
title = {Recognizing Tiny Faces},
year = {2019},
month = {August},
school = {},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-19-72},
keywords = {Face, small object, recognition},
} 2019-08-13T16:03:21-04:00