Rating is available when the video has been rented.
This feature is not available right now. Please try again later.
Published on Jan 26, 2014

For Smart Home, we already have face recognition to identify users. What if we can use non-rigid 3D face tracking(*) to control your smart home? Here I bring 3 use cases.

1.Smart Mirror: Before you leave home, it can check UV index of today, and visualize predicted sunburn effect on your face. In addtion, it can put other’s face from Pinterest on your face.

2.ExtenDisplay: Researches are often interested in user’s attention in screen. But gaze outside the screen also indicates the interest. So we recognize what user is looking at and show corresponding Pinterest images to users.

3.Voiceless Control: Voiceless Control is a good alternative of voice control, when it is noisy or you don’t want to make noise. Based on trained mouth shape series, I can control home electrionics.

(*)Non-rigid 3D face tracking uses Computer Vision algorithm(Active Shape Model) to automatically locate 76 landmarks on user’s face, and reconstruct a 3D face model in real time. It works on a simple webcam(no need to use Kinect) with low power macbook air, while it is way better than simple OpenCV face tracking in terms of accuracy and face pose estimation. 3D tracking also makes it possible to put a 3D mask on face.


to add this to Watch Later

Add to

Loading playlists...