Perceiving Systems, Computer Vision

On human motion prediction using recurrent neural networks

2017

Conference Paper

ps


Human motion modelling is a classical problem at the intersection of graphics and computer vision, with applications spanning human-computer interaction, motion synthesis, and motion prediction for virtual and augmented reality. Following the success of deep learning methods in several computer vision tasks, recent work has focused on using deep recurrent neural networks (RNNs) to model human motion, with the goal of learning time-dependent representations that perform tasks such as short-term motion prediction and long-term human motion synthesis. We examine recent work, with a focus on the evaluation methodologies commonly used in the literature, and show that, surprisingly, state-of-the-art performance can be achieved by a simple baseline that does not attempt to model motion at all. We investigate this result, and analyze recent RNN methods by looking at the architectures, loss functions, and training procedures used in state-of-the-art approaches. We propose three changes to the standard RNN models typically used for human motion, which result in a simple and scalable RNN architecture that obtains state-of-the-art performance on human motion prediction.

Author(s): Julieta Martinez and Michael J. Black and Javier Romero
Book Title: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017
Pages: 4674-4683
Year: 2017
Month: July
Day: 21-26
Publisher: IEEE

Department(s): Perceiving Systems
Research Project(s): Modeling Human Movement
Bibtex Type: Conference Paper (inproceedings)
Paper Type: Conference

Event Name: IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Event Place: Honolulu, HI, USA

Address: Piscataway, NJ, USA
ISBN: 978-1-5386-0457-1
ISSN: 1063-6919

Links: arXiv

BibTex

@inproceedings{Martinez:CVPR:2017,
  title = {On human motion prediction using recurrent neural networks},
  author = {Martinez, Julieta and Black, Michael J. and Romero, Javier},
  booktitle = {Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017},
  pages = {4674-4683},
  publisher = {IEEE},
  address = {Piscataway, NJ, USA},
  month = jul,
  year = {2017},
  doi = {},
  month_numeric = {7}
}