{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/115556"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/115556","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Statistical inference in high dimensional data and machine learning","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-05-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-05-01","abstract_has_math":false,"creators":["Zhang, Yangfan"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Statistics","degree_department":null,"school":null,"contributors":["Shao, Xiaofeng","Yang, Yun","Chen, Xiaohui","Zhu, Ruoqing"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-05","date_published":"2022-05","updated_at":"2026-07-22T22:24:54Z","subjects":["Statistical Inference","High-dimensional Data","U-statistics","Stochastic Gradient Descent","Mean-field Variational Inference"],"languages":["en","eng"],"rights":["Copyright 2022 Yangfan Zhang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/115556","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Shao, Xiaofeng","Yang, Yun","Chen, Xiaohui","Zhu, Ruoqing"]},{"key":"dc:creator","label":"Author","values":["Zhang, Yangfan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-05","2022-04-22"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Statistics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Statistical Inference","High-dimensional Data","U-statistics","Stochastic Gradient Descent","Mean-field Variational Inference"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Yangfan Zhang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/115556"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-05-01","The student, Yangfan Zhang, accepted the attached license on 2022-04-18 at 20:11.","The student, Yangfan Zhang, submitted this Dissertation for approval on 2022-04-18 at 20:18.","This Dissertation was approved for publication on 2022-04-22 at 07:55.","DSpace SAF Submission Ingestion Package generated from Vireo submission #17722 on 2022-11-11 at 12:05:54","This thesis includes four projects. In the first project, we study the non-asymptotic theory of mean-field variational inference and show a BvM theorem for the variational distribution. We propose ELBO as a new criterion for model selection, and demonstrate that it is asymptotically equivalent to BIC but can have better accuracy in terms of evidence approximation. Moreover, we show the geometric convergence of the CAVI algorithm under parametric model framework. In the second project, we propose a class of $L_q$-norm based test statistics, for change point detection in the mean of high-dimensional independent data. We show the asymptotic normality and independence between the statistics with different $q$'s, so that we may combine them to construct an adaptive test with high power against both sparse and dense alternatives. The idea of self-normalization is further applied to avoid variance estimation and leads to pivotal statistics. We also propose a consistent estimator for the change point location, and combine it with a wild binary segmentation algorithm to estimate the change-point number and locations. In the third project, we also propose a class of $L_q$-norm based U-statistics for high-dimensional independent data, but are focused on global testing for model parameters. The statistics are applicable to many testing problems including testing of mean vector and its spatial sign, simultaneous testing of linear model coefficients, and testing of component-wise independence for high-dimensional observations, among others. A variant of the proposed U-statistic with monotone indexes is also considered, with which dynamic programming can be applied to alleviate the computation burden. In the fourth project, we propose an online method based on perturbed SGD to obtain the confidence interval of the true parameters efficiently. The method inherits the online nature of the SGD, and only requires two or four parallel runs of SGD-type algorithms to obtain the confidence interval in any fixed direction. We further combine our method with the UCB algorithm to deal with the bandit problem."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Statistical inference in high dimensional data and machine learning"]}]}],"canonical_facts":{"dc:contributor":["Shao, Xiaofeng","Yang, Yun","Chen, Xiaohui","Zhu, Ruoqing"],"dc:creator":["Zhang, Yangfan"],"dc:date":["2022-05","2022-04-22"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-05-01","The student, Yangfan Zhang, accepted the attached license on 2022-04-18 at 20:11.","The student, Yangfan Zhang, submitted this Dissertation for approval on 2022-04-18 at 20:18.","This Dissertation was approved for publication on 2022-04-22 at 07:55.","DSpace SAF Submission Ingestion Package generated from Vireo submission #17722 on 2022-11-11 at 12:05:54","This thesis includes four projects. In the first project, we study the non-asymptotic theory of mean-field variational inference and show a BvM theorem for the variational distribution. We propose ELBO as a new criterion for model selection, and demonstrate that it is asymptotically equivalent to BIC but can have better accuracy in terms of evidence approximation. Moreover, we show the geometric convergence of the CAVI algorithm under parametric model framework. In the second project, we propose a class of $L_q$-norm based test statistics, for change point detection in the mean of high-dimensional independent data. We show the asymptotic normality and independence between the statistics with different $q$'s, so that we may combine them to construct an adaptive test with high power against both sparse and dense alternatives. The idea of self-normalization is further applied to avoid variance estimation and leads to pivotal statistics. We also propose a consistent estimator for the change point location, and combine it with a wild binary segmentation algorithm to estimate the change-point number and locations. In the third project, we also propose a class of $L_q$-norm based U-statistics for high-dimensional independent data, but are focused on global testing for model parameters. The statistics are applicable to many testing problems including testing of mean vector and its spatial sign, simultaneous testing of linear model coefficients, and testing of component-wise independence for high-dimensional observations, among others. A variant of the proposed U-statistic with monotone indexes is also considered, with which dynamic programming can be applied to alleviate the computation burden. In the fourth project, we propose an online method based on perturbed SGD to obtain the confidence interval of the true parameters efficiently. The method inherits the online nature of the SGD, and only requires two or four parallel runs of SGD-type algorithms to obtain the confidence interval in any fixed direction. We further combine our method with the UCB algorithm to deal with the bandit problem."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/115556"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Yangfan Zhang"],"dc:subject":["Statistical Inference","High-dimensional Data","U-statistics","Stochastic Gradient Descent","Mean-field Variational Inference"],"dc:title":["Statistical inference in high dimensional data and machine learning"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Statistics"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:54Z"}