My research combines principles from Artificial Intelligence, such as Machine Learning, Natural Language Processing and Computer Vision, with concepts from psychology and computer graphics. I am most interested in understanding human communication in order to improve the state of the art in virtual avatars and human to computer interaction. My first step towards this bigger goal has been to develop models of facial animation. The next steps are to understand more abstract forms of human communication such as emotions and intention. Most of my research is data driven, for which we capture humans in 3D using our 4D scanner. My ultimate goal is to understand the building blocks that allow humans to perceive, interact and create. To finally be able to model human's inside out (body, face, mind, motion, ...) making 3D virtual avatars indistinguishable from real humans.
From Computer Vision, I am interested in:
3D human pose and shape estimation;
2D/3D head pose and shape estimation;
and new tasks arising from zero-shot learning, transfer learning and multimodal learning.
Within Computer Graphics, I am interested in:
human faces and bodies;
and human computer interaction.
For what regards Machine Learning, I am interested in:
Within Natural Language Processing, I am interested in:
language and vision,
applied psycholinguistic research.
As part of my PhD studies, I investigate ways of combining these topics to discover new and exciting tasks while solving problems and contributing to a better world. Eager to learn, pleased to discover!
Artificial Intelligence Natural Language Processing Computer Vision Transfer Learning Multimodal Learning 3D modelling.
Our goal is to understand the principles of Perception, Action and Learning in autonomous systems that successfully interact with complex environments and to use this understanding to design future systems