{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/125655"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/125655","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Optimization in the space of probability distributions with applications in statistics","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-08-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-08-01","abstract_has_math":false,"creators":["Yao, Rentian"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Statistics","degree_department":null,"school":null,"contributors":["Yang, Yun","Chen, Xiaohui","Shao, Xiaofeng","Liu, Jingbo"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-05-16","date_published":"2024-05-16","updated_at":"2026-07-22T22:25:02Z","subjects":["Optimal Transport","Bayesian Statistics","Interacting Particle Systems","Optimization"],"languages":["en","eng"],"rights":["Copyright 2024 Rentian Yao"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/125655","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Yang, Yun","Chen, Xiaohui","Shao, Xiaofeng","Liu, Jingbo"]},{"key":"dc:creator","label":"Author","values":["Yao, Rentian"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-05-16","2024-08"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Statistics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Optimal Transport","Bayesian Statistics","Interacting Particle Systems","Optimization"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Rentian Yao"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/125655"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-08-01","The student, Rentian Yao, accepted the attached license on 2024-05-06 at 09:30.","The student, Rentian Yao, submitted this Dissertation for approval on 2024-05-06 at 09:44.","This Dissertation was approved for publication on 2024-05-16 at 14:53.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20780 on 2025-02-04 at 21:15:31","Many problems in statistics can be formulated as minimizing a functional over the space of all probability distributions on a (parameter) space. Examples include approximate Bayesian computation, non-parametric estimation, and single-cell analysis in mathematical biology. This thesis aims to address the following statistical problems by developing computationally tractable algorithms with theoretical foundations: 1. In the first part, we introduce a general computational framework to implement mean-field (MF) variational inference (VI) for Bayesian models using the Wasserstein gradient flow (WGF), a modern mathematical technique for realizing a gradient flow over the space of probability distributions. We prove the statistical guarantee of MFVI and the algorithmic convergence of using WGF under mild conditions. To implement the algorithm, we propose a new constraint-free function approximation method using neural networks. 2. In the second part, we investigate the nonparametric estimation problem of estimating the distribution-state dependent drift parameter of a Mckean--Vlasov equation with a constant diffusion parameter. This equation can be treated as the stochastic differential equation of which the density evolution equation is the gradient flow to minimize a specific energy functional. 3. In the third part, we concern the optimization of a displacement convex functional over multiple distributions. We derive an exponential algorithmic convergence rate under the quadratic growth (QG) condition on the objective functional, and a slower polynomial rate in the absence of the QG condition. By applying our theory to MFVI, the dependence of the algorithmic convergence rate on the number of blocks is better compared with the result in the first project. 4. In the last part, we explore the problem of convex optimization over the space of all probability distributions. We introduce an implicit scheme for discretizing a continuous-time gradient flow relative to the Kullback--Leibler (KL) divergence. We derive an explicit algorithmic convergence rate and apply our algorithm to compute non-parametric likelihood estimators and Bayesian posterior distributions."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Optimization in the space of probability distributions with applications in statistics"]}]}],"canonical_facts":{"dc:contributor":["Yang, Yun","Chen, Xiaohui","Shao, Xiaofeng","Liu, Jingbo"],"dc:creator":["Yao, Rentian"],"dc:date":["2024-05-16","2024-08"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2026-08-01","The student, Rentian Yao, accepted the attached license on 2024-05-06 at 09:30.","The student, Rentian Yao, submitted this Dissertation for approval on 2024-05-06 at 09:44.","This Dissertation was approved for publication on 2024-05-16 at 14:53.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20780 on 2025-02-04 at 21:15:31","Many problems in statistics can be formulated as minimizing a functional over the space of all probability distributions on a (parameter) space. Examples include approximate Bayesian computation, non-parametric estimation, and single-cell analysis in mathematical biology. This thesis aims to address the following statistical problems by developing computationally tractable algorithms with theoretical foundations: 1. In the first part, we introduce a general computational framework to implement mean-field (MF) variational inference (VI) for Bayesian models using the Wasserstein gradient flow (WGF), a modern mathematical technique for realizing a gradient flow over the space of probability distributions. We prove the statistical guarantee of MFVI and the algorithmic convergence of using WGF under mild conditions. To implement the algorithm, we propose a new constraint-free function approximation method using neural networks. 2. In the second part, we investigate the nonparametric estimation problem of estimating the distribution-state dependent drift parameter of a Mckean--Vlasov equation with a constant diffusion parameter. This equation can be treated as the stochastic differential equation of which the density evolution equation is the gradient flow to minimize a specific energy functional. 3. In the third part, we concern the optimization of a displacement convex functional over multiple distributions. We derive an exponential algorithmic convergence rate under the quadratic growth (QG) condition on the objective functional, and a slower polynomial rate in the absence of the QG condition. By applying our theory to MFVI, the dependence of the algorithmic convergence rate on the number of blocks is better compared with the result in the first project. 4. In the last part, we explore the problem of convex optimization over the space of all probability distributions. We introduce an implicit scheme for discretizing a continuous-time gradient flow relative to the Kullback--Leibler (KL) divergence. We derive an explicit algorithmic convergence rate and apply our algorithm to compute non-parametric likelihood estimators and Bayesian posterior distributions."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/125655"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Rentian Yao"],"dc:subject":["Optimal Transport","Bayesian Statistics","Interacting Particle Systems","Optimization"],"dc:title":["Optimization in the space of probability distributions with applications in statistics"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Statistics"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:02Z"}