We view vision as the process of inferring the causes behind the images that we observe; that is, we want to infer the story behind the picture. The most interesting stories involve people. Consequently, our research focuses on understanding humans and their interactions with each other and with the 3D world.
We train computers to recover human behavior in fine detail, including face and hand movement. We also recover the 3D structure of the world, its motion, and the objects in it so that human movement can be placed in context.
To have an impact beyond academia we develop applications in medicine and psychology, spin off companies, and license technology. We make most of our code and data available to the research community.