Visual Face Tracking and Its Applications

This dissertation aims at developing algorithms for tracking human faces in videos for two scenarios: (1) human computer interaction HC), and (2) meeting room video analysis (MRVA). In the HCI scenario, the face usually appears close to the camera in high resolution. We explore Active Shape Model (ASM) techniques for localizing the 2D facial features in a CONDENSATION framework. The 3D face location and orientation can be inferred using an optical flow based 3D model face tracker. In the MRVA scenario, the faces are usually far away from the camera and the resolution is low. Tensor techniques are explored for localizing the faces. Various techniques, i.e., meanshift tracking, annealed particle filtering, and online model updating in generative Bayesian model and in subspaces, are explored for tracking the 212 head locations and 3D head poses. The focus of attention of the meeting attendants can then be inferred based on the head pose. As many inference tasks depend on the object appearances cropped according to the tracking result, which however is usually noisy due to outliers and imperfect models, we also explore the possibility of eliminating the appearance inconsistency caused by misalignments by simultaneously refining PCA models from the data using variational message passing (VMP) techniques, Based on the algorithms we have developed, we show the performance of a camera mouse in the HCI scenario, We also show some experiments for meeting room video indexing and retrieval in the MRVA scenario.

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Electrical Engineering

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2015

Author dc:creator

• Tu, Jilin

Contributors dc:contributor

• Thomas Huang

• Engineering, Electronics and Electrical

Language dc:language

eng

Identifier

(MiAaPQ)AAI3301238

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/81069