{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/116188"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/116188","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Approximate Bayesian inference and optimal transport","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","abstract_has_math":false,"creators":["Han, Wei"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Statistics","degree_department":null,"school":null,"contributors":["Yang, Yun","Shao, Xiaofeng","Liang, Feng","Chen, Xiaohui"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-08","date_published":"2022-08","updated_at":"2026-07-22T22:24:55Z","subjects":["Approximate Inference","Bayesian Inference"],"languages":["en","eng"],"rights":["Copyright 2022 Wei Han"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/116188","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Yang, Yun","Shao, Xiaofeng","Liang, Feng","Chen, Xiaohui"]},{"key":"dc:creator","label":"Author","values":["Han, Wei"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-08","2022-07-08"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Statistics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Approximate Inference","Bayesian Inference"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Wei Han"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/116188"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","The student, Wei Han, accepted the attached license on 2022-07-06 at 19:53.","The student, Wei Han, submitted this Dissertation for approval on 2022-07-06 at 20:02.","This Dissertation was approved for publication on 2022-07-08 at 13:50.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18158 on 2022-11-15 at 17:38:15","In this thesis, we propose novel solutions to the problems of paramteric variational inference and generative modeling. One center problem in parameteric Bayesian inference is that high-dimensional integration for computing normalizing constant is intractable, since numerical error can accumulate to an intolerable level under hundreds of multiple integration, given main stream machine learning models can easily introduce hundreds of thousands of parameters. Among many exact or approximate methods trying to address this issue, variational inference contains a various family of powerful approximates. It is originated from particle physics, and has proved accuracy in many statistical problems combined with modern convex optimization techniques and computing facility. Yet its theoretical base still needs to be explored. In this work, we examine the frequentist consistency of mean-field variational inference, which include the effect from latent parameters. This complements the previous theory which only deals with global parameters. A main drawback of mean-field inference is underestimation of uncertainty, which undermines its range of application. In this work we propose variational weighted likelihood bootstrap, a method combining mean-field methods with Bayesian bootstrap. This makes it possible to draw accurate uncertainty characterization in the mean-field framework. We also connect the optimal transport(OT) theory with variational inference by addressing the problem from OT perspective. In general, distance measure in optimal transport theory, that is, Wasserstein distance, is a much weaker measure than those studied in Bayesian learning, such as total variation, Kullback-Leiber divergence and Jensen-Shannon divergence. This property is especially useful in the case where target distribution resides in a low-dimensional manifold. In this work we exploit the OT theory and try to combine this advantage with variational inference. This leads to the convex iterative structure we introduced. Generative models are a class of probabilistic models which focus more on directly generate observations rather than traditional machine learning tasks such as density estimation. This class has been found powerful in conducting unsupervised learning, for example, image generation, video prediction and 3d object generation. Recently, it has also been employed for posterior generation. However, to be best of our knowledge, there has not been work on combining this type of model directly with W2 theory, which performs better than generic generative models due to its geometric property. In this work, we use generative modeling techniques to find optimal solution that can generate independent samples effectively. In addition, the construction of our parametrization is dictated by previous work on Monge problems. In the discrete case, it approaches posterior faster than a log-likelihood based method, with Monte Carlo approximation and numerical tricks such as softmax. Moreover, we verify the effectiveness of this model carefully with theoretical justification. In particular, by showing a Berstein–von Mises type of convergence, we prove a normal posterior can be approximated effectively and by a minimal number of parameters."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Approximate Bayesian inference and optimal transport"]}]}],"canonical_facts":{"dc:contributor":["Yang, Yun","Shao, Xiaofeng","Liang, Feng","Chen, Xiaohui"],"dc:creator":["Han, Wei"],"dc:date":["2022-08","2022-07-08"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","The student, Wei Han, accepted the attached license on 2022-07-06 at 19:53.","The student, Wei Han, submitted this Dissertation for approval on 2022-07-06 at 20:02.","This Dissertation was approved for publication on 2022-07-08 at 13:50.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18158 on 2022-11-15 at 17:38:15","In this thesis, we propose novel solutions to the problems of paramteric variational inference and generative modeling. One center problem in parameteric Bayesian inference is that high-dimensional integration for computing normalizing constant is intractable, since numerical error can accumulate to an intolerable level under hundreds of multiple integration, given main stream machine learning models can easily introduce hundreds of thousands of parameters. Among many exact or approximate methods trying to address this issue, variational inference contains a various family of powerful approximates. It is originated from particle physics, and has proved accuracy in many statistical problems combined with modern convex optimization techniques and computing facility. Yet its theoretical base still needs to be explored. In this work, we examine the frequentist consistency of mean-field variational inference, which include the effect from latent parameters. This complements the previous theory which only deals with global parameters. A main drawback of mean-field inference is underestimation of uncertainty, which undermines its range of application. In this work we propose variational weighted likelihood bootstrap, a method combining mean-field methods with Bayesian bootstrap. This makes it possible to draw accurate uncertainty characterization in the mean-field framework. We also connect the optimal transport(OT) theory with variational inference by addressing the problem from OT perspective. In general, distance measure in optimal transport theory, that is, Wasserstein distance, is a much weaker measure than those studied in Bayesian learning, such as total variation, Kullback-Leiber divergence and Jensen-Shannon divergence. This property is especially useful in the case where target distribution resides in a low-dimensional manifold. In this work we exploit the OT theory and try to combine this advantage with variational inference. This leads to the convex iterative structure we introduced. Generative models are a class of probabilistic models which focus more on directly generate observations rather than traditional machine learning tasks such as density estimation. This class has been found powerful in conducting unsupervised learning, for example, image generation, video prediction and 3d object generation. Recently, it has also been employed for posterior generation. However, to be best of our knowledge, there has not been work on combining this type of model directly with W2 theory, which performs better than generic generative models due to its geometric property. In this work, we use generative modeling techniques to find optimal solution that can generate independent samples effectively. In addition, the construction of our parametrization is dictated by previous work on Monge problems. In the discrete case, it approaches posterior faster than a log-likelihood based method, with Monte Carlo approximation and numerical tricks such as softmax. Moreover, we verify the effectiveness of this model carefully with theoretical justification. In particular, by showing a Berstein–von Mises type of convergence, we prove a normal posterior can be approximated effectively and by a minimal number of parameters."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/116188"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Wei Han"],"dc:subject":["Approximate Inference","Bayesian Inference"],"dc:title":["Approximate Bayesian inference and optimal transport"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Statistics"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:55Z"}