Perceiving Systems, Computer Vision

AMASS: Archive of Motion Capture as Surface Shapes

2019

Conference Paper

ps


Large datasets are the cornerstone of recent advances in computer vision using deep learning. In contrast, existing human motion capture (mocap) datasets are small and the motions limited, hampering progress on learning models of human motion. While there are many different datasets available, they each use a different parameterization of the body, making it difficult to integrate them into a single meta dataset. To address this, we introduce AMASS, a large and varied database of human motion that unifies 15 different optical marker-based mocap datasets by representing them within a common framework and parameterization. We achieve this using a new method, MoSh++, that converts mocap data into realistic 3D human meshes represented by a rigged body model. Here we use SMPL [26], which is widely used and provides a standard skeletal representation as well as a fully rigged surface mesh. The method works for arbitrary marker-sets, while recovering soft-tissue dynamics and realistic hand motion. We evaluate MoSh++ and tune its hyper-parameters using a new dataset of 4D body scans that are jointly recorded with marker-based mocap. The consistent representation of AMASS makes it readily useful for animation, visualization, and generating training data for deep learning. Our dataset is significantly richer than previous human motion collections, having more than 40 hours of motion data, spanning over 300 subjects, more than 11000 motions, and is available for research at https://amass.is.tue.mpg.de/.

Author(s): Naureen Mahmood and Nima Ghorbani and Nikolaus F. Troje and Gerard Pons-Moll and Michael J. Black
Book Title: Proceedings International Conference on Computer Vision
Pages: 5442--5451
Year: 2019
Month: October
Publisher: IEEE

Department(s): Perceiving Systems
Research Project(s): Markers to Avatars
Bibtex Type: Conference Paper (conference)
Paper Type: Conference

DOI: 10.1109/ICCV.2019.00554
Event Name: International Conference on Computer Vision (ICCV)
Event Place: Seoul, South Korea

Links: code
pdf
suppl
arxiv
project website
video
poster
Video:
Attachments: AMASS_Poster

BibTex

@conference{AMASS:ICCV:2019,
  title = {{AMASS}: Archive of Motion Capture as Surface Shapes},
  author = {Mahmood, Naureen and Ghorbani, Nima and Troje, Nikolaus F. and Pons-Moll, Gerard and Black, Michael J.},
  booktitle = {Proceedings International Conference on Computer Vision},
  pages = {5442--5451},
  publisher = {IEEE},
  month = oct,
  year = {2019},
  doi = {10.1109/ICCV.2019.00554},
  month_numeric = {10}
}