Header logo is ps

3D Traffic Scene Understanding from Movable Platforms

2014

Article

avg

ps


In this paper, we present a novel probabilistic generative model for multi-object traffic scene understanding from movable platforms which reasons jointly about the 3D scene layout as well as the location and orientation of objects in the scene. In particular, the scene topology, geometry and traffic activities are inferred from short video sequences. Inspired by the impressive driving capabilities of humans, our model does not rely on GPS, lidar or map knowledge. Instead, it takes advantage of a diverse set of visual cues in the form of vehicle tracklets, vanishing points, semantic scene labels, scene flow and occupancy grids. For each of these cues we propose likelihood functions that are integrated into a probabilistic generative model. We learn all model parameters from training data using contrastive divergence. Experiments conducted on videos of 113 representative intersections show that our approach successfully infers the correct layout in a variety of very challenging scenarios. To evaluate the importance of each feature cue, experiments using different feature combinations are conducted. Furthermore, we show how by employing context derived from the proposed method we are able to improve over the state-of-the-art in terms of object detection and object orientation estimation in challenging and cluttered urban environments.

Author(s): Andreas Geiger and Martin Lauer and Christian Wojek and Christoph Stiller and Raquel Urtasun
Journal: IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)
Volume: 36
Number (issue): 5
Pages: 1012-1025
Year: 2014
Month: May
Publisher: IEEE

Department(s): Autonomous Vision, Perceiving Systems
Research Project(s): Scene Understanding
Bibtex Type: Article (article)
Paper Type: Journal

Address: Los Alamitos, CA
Annote: Digital Object Identifier : 10.1109/TPAMI.2013.185
How Published: published
URL: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6613480
Attachments: pdf

BibTex

@article{Geiger2014PAMI,
  title = {3D Traffic Scene Understanding from Movable Platforms},
  author = {Geiger, Andreas and Lauer, Martin and Wojek, Christian and Stiller, Christoph and Urtasun, Raquel},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)},
  volume = {36},
  number = {5},
  pages = {1012-1025},
  howpublished = {published},
  publisher = {IEEE},
  address = {Los Alamitos, CA},
  month = may,
  year = {2014},
  annote = {Digital Object Identifier : 10.1109/TPAMI.2013.185},
  url = {http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6613480},
  month_numeric = {5}
}