Toward Robots that Understand People and Their Environment

Abstract

To interact and collaborate with people in a natural way, robots must be able to recognize objects in their environments, accurately track the actions of humans, and estimate their goals and intentions. The last years have seen strong improvements in robotic capabilities to model, detect, and track non-rigid objects such as human bodies, hands, and their own manipulators. These recent developments can serve as the basis for providing robots with an unprecedented understanding of their environment and the people therein. I will use examples from our research on modeling, detecting, and tracking articulated objects to highlight some of these advances and discuss open problems that still need to be addressed.