Perceiving Systems, Computer Vision

Dynamic FAUST: Registering Human Bodies in Motion

2017

Conference Paper

ps


While the ready availability of 3D scan data has influenced research throughout computer vision, less attention has focused on 4D data; that is 3D scans of moving nonrigid objects, captured over time. To be useful for vision research, such 4D scans need to be registered, or aligned, to a common topology. Consequently, extending mesh registration methods to 4D is important. Unfortunately, no ground-truth datasets are available for quantitative evaluation and comparison of 4D registration methods. To address this we create a novel dataset of high-resolution 4D scans of human subjects in motion, captured at 60 fps. We propose a new mesh registration method that uses both 3D geometry and texture information to register all scans in a sequence to a common reference topology. The approach exploits consistency in texture over both short and long time intervals and deals with temporal offsets between shape and texture capture. We show how using geometry alone results in significant errors in alignment when the motions are fast and non-rigid. We evaluate the accuracy of our registration and provide a dataset of 40,000 raw and aligned meshes. Dynamic FAUST extends the popular FAUST dataset to dynamic 4D data, and is available for research purposes at http://dfaust.is.tue.mpg.de.

Author(s): Federica Bogo and Javier Romero and Gerard Pons-Moll and Michael J. Black
Book Title: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017
Pages: 5573-5582
Year: 2017
Month: July
Day: 21-26
Publisher: IEEE

Department(s): Perceiving Systems
Research Project(s): 4D Shape
FAUST dataset
3D Mesh Registration
Bibtex Type: Conference Paper (inproceedings)
Paper Type: Conference

Event Name: IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Event Place: Honolulu, HI, USA

Address: Piscataway, NJ, USA
ISBN: 978-1-5386-0457-1
ISSN: 1063-6919

Links: pdf
video
Video:

BibTex

@inproceedings{dfaust:CVPR:2017,
  title = {Dynamic {FAUST}: Registering Human Bodies in Motion},
  author = {Bogo, Federica and Romero, Javier and Pons-Moll, Gerard and Black, Michael J.},
  booktitle = {Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017},
  pages = {5573-5582},
  publisher = {IEEE},
  address = {Piscataway, NJ, USA},
  month = jul,
  year = {2017},
  doi = {},
  month_numeric = {7}
}