Generalized Time Warping for Multi-modal Alignment of Human Motion

Feng Zhou and Fernando De la Torre Frade
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June, 2012.


Download
  • Adobe portable document format (pdf) (8MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Temporal alignment of human motion has been a topic of recent interest due to its applications in animation, tele-rehabilitation and activity recognition among others. This paper presents generalized time warping (GTW), an extension of dynamic time warping (DTW) for temporally aligning multi-modal sequences from multiple subjects performing similar activities. GTW solves three major drawbacks of existing approaches based on DTW: (1) GTW provides a feature weighting layer to adapt different modalities (e.g., video and motion capture data), (2) GTW extends DTW by allowing a more flexible time warping as combination of monotonic functions, (3) unlike DTW that typically incurs in quadratic cost, GTW has linear complexity. Experimental results demonstrate that GTW can efficiently solve the multi-modal temporal alignment problem and outperforms state-of-the-art DTW methods for temporal alignment of time series within the same modality.

Notes

Text Reference
Feng Zhou and Fernando De la Torre Frade, "Generalized Time Warping for Multi-modal Alignment of Human Motion," IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June, 2012.

BibTeX Reference
@inproceedings{Zhou_2012_7021,
   author = "Feng Zhou and Fernando {De la Torre Frade}",
   title = "Generalized Time Warping for Multi-modal Alignment of Human Motion",
   booktitle = "IEEE Conference on Computer Vision and Pattern Recognition (CVPR)",
   month = "June",
   year = "2012",
}