{"id":{"repo_id":"milano","oai_identifier":"oai:air.unimi.it:2434/979088"},"canonical_url":"https://search.dev.ndltd.org/etd/milano/oai:air.unimi.it:2434/979088","repository":{"repo_id":"milano","name":"Università degli Studi di Milano","base_url":"https://air.unimi.it/oai/request"},"display":{"title":"FUNCTIONAL STATISTICAL LEARNING METHODS APPLIED TO HUMAN EMOTION RECOGNITION FROM FACIAL VIDEOS","abstract":"The ever-growing fascination with automatically analyzing and understanding human behavior has inspired a profound focus on the evolution of facial expressions and the recognition of corresponding emotions. By harnessing functional statistical learning methods, we develop a comprehensive methodology that capitalizes on the dynamic properties of continuity and evolvability inherent in functional data extracted from facial videos, which possess distinct properties compared to the static facial images predominantly used in traditional research methods. Our approach employs multivariate function-on-scalar regression models and functional analysis of variance (FANOVA) to effectively separate shared information from group-specific influences and individual noise through paired group comparisons, even with limited sample sizes. The identified group patterns convey significant mean characteristics in grouped units and are further utilized as prior knowledge for multi-classification in a streamlined feature space, generating emotional agreement scores for incoming new samples. Both non-parametric and parametric multi-class classification methods are employed to assess the predictive capabilities of the multivariates. In summary, we seamlessly integrate the entire pipeline for various stages of training and testing processes within the domain of explainable automatic emotion recognition, unveiling compelling results and offering insightful interpretations that may shed new light on emotions and expressions.","abstract_html":"The ever-growing fascination with automatically analyzing and understanding human behavior has inspired a profound focus on the evolution of facial expressions and the recognition of corresponding emotions. By harnessing functional statistical learning methods, we develop a comprehensive methodology that capitalizes on the dynamic properties of continuity and evolvability inherent in functional data extracted from facial videos, which possess distinct properties compared to the static facial images predominantly used in traditional research methods. Our approach employs multivariate function-on-scalar regression models and functional analysis of variance (FANOVA) to effectively separate shared information from group-specific influences and individual noise through paired group comparisons, even with limited sample sizes. The identified group patterns convey significant mean characteristics in grouped units and are further utilized as prior knowledge for multi-classification in a streamlined feature space, generating emotional agreement scores for incoming new samples. Both non-parametric and parametric multi-class classification methods are employed to assess the predictive capabilities of the multivariates. In summary, we seamlessly integrate the entire pipeline for various stages of training and testing processes within the domain of explainable automatic emotion recognition, unveiling compelling results and offering insightful interpretations that may shed new light on emotions and expressions.","abstract_has_math":false,"creators":["JI, RONGJIAO"],"institution":"Università degli Studi di Milano","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":["tutor: A. MICHELETTI","N. K. JERINKIC","Z. DESNICA ; coordinatore: R. ZUFFADA","R. Ji","MICHELETTI, ALESSANDRA","ZUFFADA, ROBERTO"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-06-15","date_published":"2023-06-15","updated_at":"2026-07-27T20:19:03Z","subjects":["fda","emotion recognition","expression evolution","action units","Settore MAT/06 - Probabilita' e Statistica Matematica","Settore SECS-S/01 - Statistica"],"languages":["eng"],"rights":["info:eu-repo/semantics/openAccess"],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["http://dx.doi.org/10.13130/ji-rongjiao_phd2023-06-15","10.13130/ji-rongjiao_phd2023-06-15"],"render_values":[{"text":"http://dx.doi.org/10.13130/ji-rongjiao_phd2023-06-15","href":"http://dx.doi.org/10.13130/ji-rongjiao_phd2023-06-15","code":true},{"text":"10.13130/ji-rongjiao_phd2023-06-15","href":"https://doi.org/10.13130/ji-rongjiao_phd2023-06-15","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/2434/979088","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["tutor: A. MICHELETTI","N. K. JERINKIC","Z. DESNICA ; coordinatore: R. ZUFFADA","R. Ji","MICHELETTI, ALESSANDRA","ZUFFADA, ROBERTO"]},{"key":"dc:creator","label":"Author","values":["JI, RONGJIAO"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-06-15"]},{"key":"dc:publisher","label":"Institution","values":["Università degli Studi di Milano"]},{"key":"dc:type","label":"Dc Type","values":["info:eu-repo/semantics/doctoralThesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["fda","emotion recognition","expression evolution","action units","Settore MAT/06 - Probabilita' e Statistica Matematica","Settore SECS-S/01 - Statistica"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["info:eu-repo/semantics/openAccess"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2434/979088","http://dx.doi.org/10.13130/ji-rongjiao_phd2023-06-15","10.13130/ji-rongjiao_phd2023-06-15"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The ever-growing fascination with automatically analyzing and understanding human behavior has inspired a profound focus on the evolution of facial expressions and the recognition of corresponding emotions. By harnessing functional statistical learning methods, we develop a comprehensive methodology that capitalizes on the dynamic properties of continuity and evolvability inherent in functional data extracted from facial videos, which possess distinct properties compared to the static facial images predominantly used in traditional research methods. Our approach employs multivariate function-on-scalar regression models and functional analysis of variance (FANOVA) to effectively separate shared information from group-specific influences and individual noise through paired group comparisons, even with limited sample sizes. The identified group patterns convey significant mean characteristics in grouped units and are further utilized as prior knowledge for multi-classification in a streamlined feature space, generating emotional agreement scores for incoming new samples. Both non-parametric and parametric multi-class classification methods are employed to assess the predictive capabilities of the multivariates. In summary, we seamlessly integrate the entire pipeline for various stages of training and testing processes within the domain of explainable automatic emotion recognition, unveiling compelling results and offering insightful interpretations that may shed new light on emotions and expressions."]},{"key":"dc:title","label":"Title","values":["FUNCTIONAL STATISTICAL LEARNING METHODS APPLIED TO HUMAN EMOTION RECOGNITION FROM FACIAL VIDEOS"]}]}],"canonical_facts":{"dc:contributor":["tutor: A. MICHELETTI","N. K. JERINKIC","Z. DESNICA ; coordinatore: R. ZUFFADA","R. Ji","MICHELETTI, ALESSANDRA","ZUFFADA, ROBERTO"],"dc:creator":["JI, RONGJIAO"],"dc:date":["2023-06-15"],"dc:description":["The ever-growing fascination with automatically analyzing and understanding human behavior has inspired a profound focus on the evolution of facial expressions and the recognition of corresponding emotions. By harnessing functional statistical learning methods, we develop a comprehensive methodology that capitalizes on the dynamic properties of continuity and evolvability inherent in functional data extracted from facial videos, which possess distinct properties compared to the static facial images predominantly used in traditional research methods. Our approach employs multivariate function-on-scalar regression models and functional analysis of variance (FANOVA) to effectively separate shared information from group-specific influences and individual noise through paired group comparisons, even with limited sample sizes. The identified group patterns convey significant mean characteristics in grouped units and are further utilized as prior knowledge for multi-classification in a streamlined feature space, generating emotional agreement scores for incoming new samples. Both non-parametric and parametric multi-class classification methods are employed to assess the predictive capabilities of the multivariates. In summary, we seamlessly integrate the entire pipeline for various stages of training and testing processes within the domain of explainable automatic emotion recognition, unveiling compelling results and offering insightful interpretations that may shed new light on emotions and expressions."],"dc:identifier":["https://hdl.handle.net/2434/979088","http://dx.doi.org/10.13130/ji-rongjiao_phd2023-06-15","10.13130/ji-rongjiao_phd2023-06-15"],"dc:language":["eng"],"dc:publisher":["Università degli Studi di Milano"],"dc:rights":["info:eu-repo/semantics/openAccess"],"dc:subject":["fda","emotion recognition","expression evolution","action units","Settore MAT/06 - Probabilita' e Statistica Matematica","Settore SECS-S/01 - Statistica"],"dc:title":["FUNCTIONAL STATISTICAL LEARNING METHODS APPLIED TO HUMAN EMOTION RECOGNITION FROM FACIAL VIDEOS"],"dc:type":["info:eu-repo/semantics/doctoralThesis"]},"updated_at":"2026-07-27T20:19:03Z"}