Thursday, 30th of November 2017, 12:00 – 1:00

Multimodal Social Signals Analysis

SR 1, ICT Building,
Technikerstraße 21a, 6020 Innsbruck


Nicu Sebe
Head of Dept. of Information Engineering and Computer Science
Leader of Multimedia and Human Understanding Group (MHUG)
University of Trento


Social perception is the main channel through which human beings access the social world, very much like vision and hearing are channels through which people access the physical world. For a long time, researchers have addressed the computational implementation of vision and hearing in domains like computer vision and speech recognition, but only early attempts have been made to do the same with social perception. We believe social perception to be one of the missing links in the communication between humans and computers, and so in this presentation I will present our recent research in social signals analysis (e.g., head pose, camera-based heart rate estimation). We will concentrate on behavior modeling and recognition, with an emphasis on sensing and understanding users’ actions and intentions for achieving multimodal human-computer interaction in natural settings, in particular pertaining to human dynamic face and body behavior in context dependent situations (task, mood/affect). Perspectives on multisensory observation will be addressed.

Nicu Sebe is a professor in the University of Trento, Italy, where he is the Dean of the Department of Information Engineering and Computer Science. He is leading the research in the areas of multimedia information retrieval and human-computer interaction in computer vision applications. He was involved in the organization of the major conferences and workshops addressing the computer vision and human-centered  aspects of multimedia information retrieval, among which as a General Co-Chair of the IEEE Automatic Face and Gesture Recognition Conference, FG 2008, ACM International Conference on Image and Video Retrieval (CIVR) 2007 and 2010. He was a general  chair of ACM Multimedia 2013 and ACM ICMR 2017 and a program chair of ACM Multimedia 2007 and 2011, ECCV 2016, and ICCV 2017. He is a program chair ICPR 2020. Currently he is the ACM SIGMM Vice Chair. He is a fellow of IAPR and a Senior member of ACM and IEEE.