Adversarial Geometry-Aware Human Motion Prediction

Yuxiong Wang, Liang-Yan Gui, Xiaodan Liang and Jose M. F. Moura
Conference Paper, European Conference on Computer Vision (ECCV), October, 2018

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


We explore an approach to forecasting human motion in a few milliseconds given an input 3D skeleton sequence based on a recurrent encoder-decoder framework. Current approaches suffer from the problem of prediction discontinuities and may fail to predict human-like motion in longer time horizons due to error accumulation. We address these critical issues by incorporating local geometric structure constraints and regularizing predictions with plausible temporal smoothness and continuity from a global perspective. Specifically, rather than using the conventional Euclidean loss, we propose a novel frame-wise geodesic loss as a geometrically meaningful, more precise distance measurement. Moreover, inspired by the adversarial training mechanism, we present a new learning procedure to simultaneously validate the sequence-level plausibility of the prediction and its coherence with the input sequence by introducing two global recurrent discriminators. An unconditional, fidelity discriminator and a conditional, continuity discriminator are jointly trained along with the predictor in an adversarial manner. Our resulting adversarial geometry-aware encoder-decoder (AGED) model significantly outperforms state-of-the-art deep learning based approaches on the heavily benchmarked H3.6M dataset in both short-term and long-term predictions.

author = {Yuxiong Wang and Liang-Yan Gui and Xiaodan Liang and Jose M. F. Moura},
title = {Adversarial Geometry-Aware Human Motion Prediction},
booktitle = {European Conference on Computer Vision (ECCV)},
year = {2018},
month = {October},
publisher = {Springer},
keywords = {human motion prediction, adversarial learning, geodesic loss},
} 2018-12-07T08:01:46-04:00