{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/120227"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/120227","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Some advances in Bayesian inference and generative modeling","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","abstract_has_math":false,"creators":["Tang, Rong"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Statistics","degree_department":null,"school":null,"contributors":["Yang, Yun","Chen, Xiaohui","Liang, Feng","Zhu, Ruoqing"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-05","date_published":"2023-05","updated_at":"2026-07-22T22:24:57Z","subjects":["Bayesian Inference","Generative Modeling","Variational Autoencoder","Minimax Rate","Adversarial Losses","Mixing Time"],"languages":["en","eng"],"rights":["Copyright 2023 Rong Tang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/120227","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Yang, Yun","Chen, Xiaohui","Liang, Feng","Zhu, Ruoqing"]},{"key":"dc:creator","label":"Author","values":["Tang, Rong"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-05","2023-04-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Statistics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Bayesian Inference","Generative Modeling","Variational Autoencoder","Minimax Rate","Adversarial Losses","Mixing Time"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2023 Rong Tang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/120227"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","The student, Rong Tang, accepted the attached license on 2023-03-30 at 12:34.","The student, Rong Tang, submitted this Dissertation for approval on 2023-03-30 at 12:43.","This Dissertation was approved for publication on 2023-04-05 at 11:20.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18904 on 2023-09-01 at 17:07:53","Statisticians often seek the ability to work with complex statistical models that can provide a comprehensive understanding of complicated data sets without making restrictive assumptions on their distribution. In machine learning, (deep) generative modeling has achieved great success in learning complicated high-dimensional distributions, such as creating synthetic images and texts with some variations. Instead of seeking a mathematical expression for the probability, generative modeling aims to obtain a generator (encoder) that can map samples from a simple prior distribution to points that resemble the given data. Presenting a complicated distribution through a generative model allows for efficient implementation, as generators are usually easier to optimize than distributions with constraints. Bayesian inference is another popular approach for analyzing complex data and has great applications in various fields, such as social science, biomedicine, genomics, and signal processing. Unlike generative modeling, Bayesian inference aims to specify a full probability model and perform inference conditional on both the model and data. In this dissertation, we will focus on both generative modeling and Bayesian inference. The first part of this dissertation aims to present practitioners with some advances in generative modeling. In the first project of the dissertation, we focus on a popular class of generative modeling methods, called variational autoencoders (VAE). We establish a theoretical framework for analyzing the excess risk associated with VAE under the setting of density estimation, covering both parametric and nonparametric cases, through the lens of M-estimation. The second project addresses a follow-up problem concerning the fundamental limit of estimating unknown manifold-supported distribution in terms of minimax rate under adversarial losses. The established minimax rate clarifies how various problem characteristics, including data intrinsic dimension, target distribution and manifold smoothness levels, affect the fundamental limit of high-dimensional distribution estimation. In the third project, we apply some of the techniques from the second project to study nonparametric two-sample hypothesis testing under adversarial losses. We characterize the optimal detection boundary of two-sample testing in terms of the dimensionalities and smoothness levels of the underlying densities and the discriminator class defining the adversarial loss. Furthermore, we propose a testing procedure that can simultaneously attain the optimal detection boundary under many common adversarial losses, including those induced by the $\\ell_1$, $\\ell_2$ distances and Wasserstein distances. The second part of this dissertation aims to investigate research problems in the field of Bayesian inference. In the fourth project, we investigate the feasibility of conducting valid Bayesian uncertainty quantification in empirical risk minimization. To achieve this, we propose a novel Bayesian inferential approach that substitutes the (misspecified or partly specified) likelihoods with proper exponentially tilted empirical likelihoods plus a regularization term. We demonstrate that the Bayesian credible regions derived from the proposed posterior are automatically calibrated to deliver valid uncertainty quantification. We also consider extensions of our method to high-dimensional models under sparsity constraints by incorporating sparsity-inducing priors. In the fifth project, we delve into the Bayesian computational aspect by analyzing the computational complexity of sampling from a Bayesian posterior using the Metropolis-adjusted Langevin algorithm (MALA). We establish that the optimal parameter dimension dependence of MALA's non-asymptotic mixing time after the burn-in period, when the target Bayesian posterior is near Gaussian, is $d^{1/3}$."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Some advances in Bayesian inference and generative modeling"]}]}],"canonical_facts":{"dc:contributor":["Yang, Yun","Chen, Xiaohui","Liang, Feng","Zhu, Ruoqing"],"dc:creator":["Tang, Rong"],"dc:date":["2023-05","2023-04-05"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","The student, Rong Tang, accepted the attached license on 2023-03-30 at 12:34.","The student, Rong Tang, submitted this Dissertation for approval on 2023-03-30 at 12:43.","This Dissertation was approved for publication on 2023-04-05 at 11:20.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18904 on 2023-09-01 at 17:07:53","Statisticians often seek the ability to work with complex statistical models that can provide a comprehensive understanding of complicated data sets without making restrictive assumptions on their distribution. In machine learning, (deep) generative modeling has achieved great success in learning complicated high-dimensional distributions, such as creating synthetic images and texts with some variations. Instead of seeking a mathematical expression for the probability, generative modeling aims to obtain a generator (encoder) that can map samples from a simple prior distribution to points that resemble the given data. Presenting a complicated distribution through a generative model allows for efficient implementation, as generators are usually easier to optimize than distributions with constraints. Bayesian inference is another popular approach for analyzing complex data and has great applications in various fields, such as social science, biomedicine, genomics, and signal processing. Unlike generative modeling, Bayesian inference aims to specify a full probability model and perform inference conditional on both the model and data. In this dissertation, we will focus on both generative modeling and Bayesian inference. The first part of this dissertation aims to present practitioners with some advances in generative modeling. In the first project of the dissertation, we focus on a popular class of generative modeling methods, called variational autoencoders (VAE). We establish a theoretical framework for analyzing the excess risk associated with VAE under the setting of density estimation, covering both parametric and nonparametric cases, through the lens of M-estimation. The second project addresses a follow-up problem concerning the fundamental limit of estimating unknown manifold-supported distribution in terms of minimax rate under adversarial losses. The established minimax rate clarifies how various problem characteristics, including data intrinsic dimension, target distribution and manifold smoothness levels, affect the fundamental limit of high-dimensional distribution estimation. In the third project, we apply some of the techniques from the second project to study nonparametric two-sample hypothesis testing under adversarial losses. We characterize the optimal detection boundary of two-sample testing in terms of the dimensionalities and smoothness levels of the underlying densities and the discriminator class defining the adversarial loss. Furthermore, we propose a testing procedure that can simultaneously attain the optimal detection boundary under many common adversarial losses, including those induced by the $\\ell_1$, $\\ell_2$ distances and Wasserstein distances. The second part of this dissertation aims to investigate research problems in the field of Bayesian inference. In the fourth project, we investigate the feasibility of conducting valid Bayesian uncertainty quantification in empirical risk minimization. To achieve this, we propose a novel Bayesian inferential approach that substitutes the (misspecified or partly specified) likelihoods with proper exponentially tilted empirical likelihoods plus a regularization term. We demonstrate that the Bayesian credible regions derived from the proposed posterior are automatically calibrated to deliver valid uncertainty quantification. We also consider extensions of our method to high-dimensional models under sparsity constraints by incorporating sparsity-inducing priors. In the fifth project, we delve into the Bayesian computational aspect by analyzing the computational complexity of sampling from a Bayesian posterior using the Metropolis-adjusted Langevin algorithm (MALA). We establish that the optimal parameter dimension dependence of MALA's non-asymptotic mixing time after the burn-in period, when the target Bayesian posterior is near Gaussian, is $d^{1/3}$."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/120227"],"dc:language":["en","eng"],"dc:rights":["Copyright 2023 Rong Tang"],"dc:subject":["Bayesian Inference","Generative Modeling","Variational Autoencoder","Minimax Rate","Adversarial Losses","Mixing Time"],"dc:title":["Some advances in Bayesian inference and generative modeling"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Statistics"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:57Z"}