{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/49853"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/49853","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"3D face processing for animation and biometrics","abstract":"In this dissertation we study core problems in 3D face processing with their important applications in biometrics and graphics. We propose efficient and accurate feature based algorithms for facial feature detection, 3D model fitting and tracking from static and dynamic 2D and 3D visual signal input. We also demonstrate the applications of 3D face modeling in avatar animation, expression recognition and eye gaze estimation. The algorithms contribute to a complete framework for image and video analysis and synthesis based on 3D face models. From the experiments on the self-collected and public database, we argue that feature based 3D face processing is robust to variations of environment, competent for highly accurate reconstruction of 3D facial geometry and motion, and suitable for realtime biometrics and animation applications. The contributions of this dissertation include: (1) A novel interactive robust facial component localization algorithm designed to accommodate partial labels on natural images. (2) A new challenging dataset for facial component localization which contains 2330 high-resolution, accurately labeled face images and has larger degree of out-of-plane orientation and occlusion typical of real-world scenarios. (3) Efficient algorithms for fitting and tracking of 3D model to 2D videos and RGB-D videos based on an iterative linearized optimization procedure. (4) An MPEG-4 compatible performance driven avatar capable of rendering of highly detail shape and texture of the subject in real time. (5) A new method for measuring similarity of 3D facial shapes using facial level curves. The measurement comprises the spatio-temporal features for expression recognition from 3D dynamic faces through a hidden Markov model. (6) An efficient and accurate system for measuring the online student's point of gaze using commodity webcams.","abstract_html":"In this dissertation we study core problems in 3D face processing with their important applications in biometrics and graphics. We propose efficient and accurate feature based algorithms for facial feature detection, 3D model fitting and tracking from static and dynamic 2D and 3D visual signal input. We also demonstrate the applications of 3D face modeling in avatar animation, expression recognition and eye gaze estimation. The algorithms contribute to a complete framework for image and video analysis and synthesis based on 3D face models. From the experiments on the self-collected and public database, we argue that feature based 3D face processing is robust to variations of environment, competent for highly accurate reconstruction of 3D facial geometry and motion, and suitable for realtime biometrics and animation applications. The contributions of this dissertation include: (1) A novel interactive robust facial component localization algorithm designed to accommodate partial labels on natural images. (2) A new challenging dataset for facial component localization which contains 2330 high-resolution, accurately labeled face images and has larger degree of out-of-plane orientation and occlusion typical of real-world scenarios. (3) Efficient algorithms for fitting and tracking of 3D model to 2D videos and RGB-D videos based on an iterative linearized optimization procedure. (4) An MPEG-4 compatible performance driven avatar capable of rendering of highly detail shape and texture of the subject in real time. (5) A new method for measuring similarity of 3D facial shapes using facial level curves. The measurement comprises the spatio-temporal features for expression recognition from 3D dynamic faces through a hidden Markov model. (6) An efficient and accurate system for measuring the online student's point of gaze using commodity webcams.","abstract_has_math":false,"creators":["Le, Vuong"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Huang, Thomas S.","Do, Minh N.","Hart, John C.","Levinson, Stephen E."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2014,"date_issued":"2014-05-30T17:21:07Z","date_published":"2014-05-30T17:21:07Z","updated_at":"2026-07-22T22:25:40Z","subjects":["3D shape modeling","performance driven avatar","3D morphable model","face tracking","optical flow","gaze estimation","facial animation","facial feature localization","expression recognition","nonrigid tracking","motion model"],"languages":["en"],"rights":["Copyright 2014 Vuong Van Le"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/49853","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Huang, Thomas S.","Do, Minh N.","Hart, John C.","Levinson, Stephen E."]},{"key":"dc:creator","label":"Author","values":["Le, Vuong"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2014-05-30T17:21:07Z","2016-09-22T20:59:31Z","2014-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["3D shape modeling","performance driven avatar","3D morphable model","face tracking","optical flow","gaze estimation","facial animation","facial feature localization","expression recognition","nonrigid tracking","motion model"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2014 Vuong Van Le"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/49853"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In this dissertation we study core problems in 3D face processing with their important applications in biometrics and graphics. We propose efficient and accurate feature based algorithms for facial feature detection, 3D model fitting and tracking from static and dynamic 2D and 3D visual signal input. We also demonstrate the applications of 3D face modeling in avatar animation, expression recognition and eye gaze estimation. The algorithms contribute to a complete framework for image and video analysis and synthesis based on 3D face models. From the experiments on the self-collected and public database, we argue that feature based 3D face processing is robust to variations of environment, competent for highly accurate reconstruction of 3D facial geometry and motion, and suitable for realtime biometrics and animation applications. The contributions of this dissertation include: (1) A novel interactive robust facial component localization algorithm designed to accommodate partial labels on natural images. (2) A new challenging dataset for facial component localization which contains 2330 high-resolution, accurately labeled face images and has larger degree of out-of-plane orientation and occlusion typical of real-world scenarios. (3) Efficient algorithms for fitting and tracking of 3D model to 2D videos and RGB-D videos based on an iterative linearized optimization procedure. (4) An MPEG-4 compatible performance driven avatar capable of rendering of highly detail shape and texture of the subject in real time. (5) A new method for measuring similarity of 3D facial shapes using facial level curves. The measurement comprises the spatio-temporal features for expression recognition from 3D dynamic faces through a hidden Markov model. (6) An efficient and accurate system for measuring the online student's point of gaze using commodity webcams.","Item withdrawn by Laura Spradlin (lspradl2@illinois.edu) on 2014-04-21T15:51:20Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 VuongLe_Thesis_Final.pdf: 9986129 bytes, checksum: e55542fce35f5e393a04393ba3d85b2c (MD5)","Made available in DSpace on 2014-05-30T17:21:07Z (GMT). No. of bitstreams: 2 Vuong_Le.pdf: 9986129 bytes, checksum: e55542fce35f5e393a04393ba3d85b2c (MD5) license.txt: 4058 bytes, checksum: 917228d58f48754cb23c707be76117b1 (MD5)","Restriction data tranferred 2014-07-01T11:39:51-05:00 Original Data Group with Access Administrator Release Date: 2016-05-30 12:21:23 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (robbins.sd@gmail.com) on 2014-05-30T17:21:49Z Item is restricted until 2016-05-30T17:21:23Z","Limited Restriction Lifted for Item 49904 on 2016-09-22T20:59:31Z."]},{"key":"dc:title","label":"Title","values":["3D face processing for animation and biometrics"]}]}],"canonical_facts":{"dc:contributor":["Huang, Thomas S.","Do, Minh N.","Hart, John C.","Levinson, Stephen E."],"dc:creator":["Le, Vuong"],"dc:date":["2014-05-30T17:21:07Z","2016-09-22T20:59:31Z","2014-05"],"dc:description":["In this dissertation we study core problems in 3D face processing with their important applications in biometrics and graphics. We propose efficient and accurate feature based algorithms for facial feature detection, 3D model fitting and tracking from static and dynamic 2D and 3D visual signal input. We also demonstrate the applications of 3D face modeling in avatar animation, expression recognition and eye gaze estimation. The algorithms contribute to a complete framework for image and video analysis and synthesis based on 3D face models. From the experiments on the self-collected and public database, we argue that feature based 3D face processing is robust to variations of environment, competent for highly accurate reconstruction of 3D facial geometry and motion, and suitable for realtime biometrics and animation applications. The contributions of this dissertation include: (1) A novel interactive robust facial component localization algorithm designed to accommodate partial labels on natural images. (2) A new challenging dataset for facial component localization which contains 2330 high-resolution, accurately labeled face images and has larger degree of out-of-plane orientation and occlusion typical of real-world scenarios. (3) Efficient algorithms for fitting and tracking of 3D model to 2D videos and RGB-D videos based on an iterative linearized optimization procedure. (4) An MPEG-4 compatible performance driven avatar capable of rendering of highly detail shape and texture of the subject in real time. (5) A new method for measuring similarity of 3D facial shapes using facial level curves. The measurement comprises the spatio-temporal features for expression recognition from 3D dynamic faces through a hidden Markov model. (6) An efficient and accurate system for measuring the online student's point of gaze using commodity webcams.","Item withdrawn by Laura Spradlin (lspradl2@illinois.edu) on 2014-04-21T15:51:20Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 VuongLe_Thesis_Final.pdf: 9986129 bytes, checksum: e55542fce35f5e393a04393ba3d85b2c (MD5)","Made available in DSpace on 2014-05-30T17:21:07Z (GMT). No. of bitstreams: 2 Vuong_Le.pdf: 9986129 bytes, checksum: e55542fce35f5e393a04393ba3d85b2c (MD5) license.txt: 4058 bytes, checksum: 917228d58f48754cb23c707be76117b1 (MD5)","Restriction data tranferred 2014-07-01T11:39:51-05:00 Original Data Group with Access Administrator Release Date: 2016-05-30 12:21:23 UTC Reason: Author requested closed access (OA after 2yrs) in Vireo ETD system","Item marked as restricted to the 'Administrator' Group (id=1) by Seth Robbins (robbins.sd@gmail.com) on 2014-05-30T17:21:49Z Item is restricted until 2016-05-30T17:21:23Z","Limited Restriction Lifted for Item 49904 on 2016-09-22T20:59:31Z."],"dc:identifier":["http://hdl.handle.net/2142/49853"],"dc:language":["en"],"dc:rights":["Copyright 2014 Vuong Van Le"],"dc:subject":["3D shape modeling","performance driven avatar","3D morphable model","face tracking","optical flow","gaze estimation","facial animation","facial feature localization","expression recognition","nonrigid tracking","motion model"],"dc:title":["3D face processing for animation and biometrics"],"dc:type":["text"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:40Z"}