Efficient and Accurate Facial Expression Tracking on Glasses

We aim to reconstruct and track the wearer's facial expressions from headset-native sensors with the goal to capture both verbal and non-verbal expressions. The project comprises a comprehensive data collection and the implementation of baselines for facial reconstruction.

Project Team

Prof. Christian Holz

Christian Holz is an Associate Professor at ETH Zurich in the Computer Science Department where he leads the Sensing, Interaction and Perception Lab. Their research focuses on input decoding and interaction in mixed reality settings as well as continuous healthcare monitoring for predictive diagnostics and personalized medicine. Before joining ETH Zürich, Christian Holz was a principal researcher at Microsoft Research, Redmond.  

Dr. David Kim

XR Perceptive Experiences Lead

Dr. Sergio Orts Escolano

Senior Staff Research Scientist and Manager

Björn Braun

Björn Braun is a PhD student at SIPLAB, ETH Zurich. He specializes in deep learning, computer vision and non-contact physiological sensing. His research focuses on developing novel deep learning models that predict a person's emotions and physiological signals - such as heart rate - from egocentric systems (e.g., Project Aria glasses), videos, and wearable devices.

Publications

No entries.