Loading Events

VASC Seminar

September

29
Wed
Iasonas Kokkinos Research Manager Snap Inc, UCL
Wednesday, September 29
10:50 am to 11:50 am
Humans, hands, and horses: 3D reconstruction of articulated object categories using strong, weak, and self-supervision

Abstract:

Reconstructing 3D objects from a single 2D image is a task that humans perform effortlessly,  yet computer vision so far has only robustly solved 3D face reconstruction.
In this talk we will see how we can extend the scope of monocular 3D reconstruction to more challenging, articulated categories such as human bodies, hands and also animals such as birds, horses or cows.
We  will see that careful geometric modeling and optimization can deliver large rewards in particular as supervision becomes weaker and will demonstrate real-time, mobile phone-powered, Augmented Reality applications developed around the human body and hands.

We will start from monocular 3D human pose estimation in-the-wild and describe HoloPose, a method that combines bottom-up,  CNN-based methods for image understanding, with top-down parametric model fitting.
We will then see how parametric model fitting can be used during training to supervise state-of-the-art feedforward CNNs and deliver state-of-the-art, real-time monocular hand mesh reconstruction.

We will finally turn to self-supervised, non-rigid structure from motion-based approaches that allow us to reconstruct articulated object categories in 3D with hardly any supervision, allowing us to learn the parametric 3D deformation model in an end-to-end manner.

 

Bio:

Iasonas Kokkinos is Research Manager in Snap and Associate Professor in the Department of Computer Science of University College London (UCL).

Iasonas obtained his D.Eng in 2001 and PhD in 2006 from NTUA, was a postdoc in UCLA until 2008, and then joined the faculty of Ecole Centrale Paris where he stayed until 2016, prior to joining UCL.
In 2016 he started working in industry as a research scientist with Facebook AI Research and then in 2018 he co-founded and served as CEO of Ariel AI, focusing on monocular human reconstruction for augmented reality; in 2020 he joined Snap as Research Manager following the acquisition of Ariel AI.

His research interests are at the intersection of  computer vision and deep learning, aiming at the development of models that unify problems of structured prediction and 3D shape modeling with deep learning, as well as multi-task learning. He publishes, reviews, and frequently serves as Area Chair in the major computer vision conferences (CVPR,ICCV,ECCV).

 

Homepagehttp://www0.cs.ucl.ac.uk/staff/I.Kokkinos/

 

 

Sponsored in part by:   Facebook Reality Labs Pittsburgh