{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/129437"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/129437","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Physics-informed machine learning methods for environmental modeling and uncertainty quantification","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","abstract_has_math":false,"creators":["Zong, Yifei"],"institution":"University of Illinois Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Civil Engineering","degree_department":null,"school":null,"contributors":["Tartakovsky, Alexandre","Valocchi, Albert","Kumar, Praveen","Meidani, Hadi"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-04-25","date_published":"2025-04-25","updated_at":"2026-07-22T22:25:05Z","subjects":["Physics-informed Machine Learning","Environmental Modeling","Uncertainty Quantification"],"languages":["en","eng"],"rights":["Copyright 2025 Yifei Zong"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/129437","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Tartakovsky, Alexandre","Valocchi, Albert","Kumar, Praveen","Meidani, Hadi"]},{"key":"dc:creator","label":"Author","values":["Zong, Yifei"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-04-25","2025-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Civil Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Physics-informed Machine Learning","Environmental Modeling","Uncertainty Quantification"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Yifei Zong"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/129437"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","The student, Yifei Zong, accepted the attached license on 2025-04-23 at 17:51.","The student, Yifei Zong, submitted this Dissertation for approval on 2025-04-23 at 17:56.","This Dissertation was approved for publication on 2025-04-25 at 15:30.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21930 on 2025-10-19 at 18:18:51","Machine learning approaches are increasingly recognized for enhancing prediction and model inversion in natural and engineering systems due to their high expressivity, improved training algorithms, and fast inference speed. However, effectively applying data-driven machine learning methods for environmental problems, particularly in data-limited contexts such as subsurface modeling and large-scale climate simulations, remains challenging. One major limitation is the scarcity of high-quality data that accurately captures the heterogeneous and multi-scale nature of these systems. Additionally, environmental problems are often high-dimensional, making them susceptible to the ``curse of dimensionality (CoD).\" This poses significant computational challenges, especially in inverse parameter estimation, uncertainty quantification (UQ), and design and optimization tasks, where solving these problems requires extensive physics-based simulations. To address these challenges, our research aims to develop machine learning approaches that integrate physical domain knowledge (i.e., governing physical equations) as a form of regularization. Additionally, we explore efficient algorithms to mitigate the effects of high dimensionality in inverse problems and UQ. Our research unfolds into three well-defined objectives: The first is physics-informed machine learning for deterministic PDE problems. Here, we focus on developing, improving, and analyzing physics-informed machine learning approaches in the deterministic regime, designed to accurately approximate solutions to partial differential equations (PDEs) as well as learning PDE operators. We propose an improved training framework for physics-informed neural networks (PINNs) that systematically targets different sources of PINN errors. The effectiveness of our improved PINN model is demonstrated in forward, inverse, and backward advection-dispersion equations (ADEs) with sharply perturbed initial conditions, where conventional PINNs struggle to learn effectively. We also introduce a reduced-order method called the physics-informed Karhunen-Lo\\`eve expansion (PICKLE), which combines model reduction techniques with physics-informed machine learning to efficiently solve space-time-dependent PDE problems. A key advantage of these two methods is their ability to seamlessly assimilate additional data, which can enhance model training and improve predictive accuracy. Additionally, we propose reduced-order neural operator surrogate models, including KL-DNN and VAE-DNN, which employ the dimension reduction technique to identify low-dimensional subspaces and construct operator-based mappings between PDE parameters and solutions. These surrogate models offer significant computational and energy efficiency, as they can be trained in separate components while maintaining accuracy comparable to state-of-the-art neural operators such as the Fourier Neural Operator. The second objective is to develop scalable UQ methods to address the challenges posed by complex posterior distributions in high-dimensional, PDE-constrained inverse problems. These problems are often affected by the CoD and exhibit pathological behaviors in high-dimensional probability spaces, making existing Bayesian inference computationally demanding. We propose a Bayesian UQ framework based on the randomize-then-optimize approach, which enables efficient posterior sampling by tailoring the optimization process to the loss functions of our physics-informed machine learning models, including PINN and PICKLE. The third objective is to develop effective digital twins capable of accurately and rapidly predicting PDE solutions under a wide range of control variables while remaining differentiable with respect to them. To achieve this, we integrate the proposed neural operator-based surrogate models with transfer learning techniques, allowing models trained on one set of conditions to generalize efficiently to new scenarios with minimal retraining. Additionally, we provide a rigorous mathematical analysis of the transferability of these surrogate models for both linear and nonlinear PDEs. This thesis outlines a comprehensive roadmap for advancing physics-informed machine learning techniques. We present numerical results for each objective, demonstrating their effectiveness and laying the foundation for broader applications toward large, real-world problems."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Physics-informed machine learning methods for environmental modeling and uncertainty quantification"]}]}],"canonical_facts":{"dc:contributor":["Tartakovsky, Alexandre","Valocchi, Albert","Kumar, Praveen","Meidani, Hadi"],"dc:creator":["Zong, Yifei"],"dc:date":["2025-04-25","2025-05"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-19 without embargo terms","The student, Yifei Zong, accepted the attached license on 2025-04-23 at 17:51.","The student, Yifei Zong, submitted this Dissertation for approval on 2025-04-23 at 17:56.","This Dissertation was approved for publication on 2025-04-25 at 15:30.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21930 on 2025-10-19 at 18:18:51","Machine learning approaches are increasingly recognized for enhancing prediction and model inversion in natural and engineering systems due to their high expressivity, improved training algorithms, and fast inference speed. However, effectively applying data-driven machine learning methods for environmental problems, particularly in data-limited contexts such as subsurface modeling and large-scale climate simulations, remains challenging. One major limitation is the scarcity of high-quality data that accurately captures the heterogeneous and multi-scale nature of these systems. Additionally, environmental problems are often high-dimensional, making them susceptible to the ``curse of dimensionality (CoD).\" This poses significant computational challenges, especially in inverse parameter estimation, uncertainty quantification (UQ), and design and optimization tasks, where solving these problems requires extensive physics-based simulations. To address these challenges, our research aims to develop machine learning approaches that integrate physical domain knowledge (i.e., governing physical equations) as a form of regularization. Additionally, we explore efficient algorithms to mitigate the effects of high dimensionality in inverse problems and UQ. Our research unfolds into three well-defined objectives: The first is physics-informed machine learning for deterministic PDE problems. Here, we focus on developing, improving, and analyzing physics-informed machine learning approaches in the deterministic regime, designed to accurately approximate solutions to partial differential equations (PDEs) as well as learning PDE operators. We propose an improved training framework for physics-informed neural networks (PINNs) that systematically targets different sources of PINN errors. The effectiveness of our improved PINN model is demonstrated in forward, inverse, and backward advection-dispersion equations (ADEs) with sharply perturbed initial conditions, where conventional PINNs struggle to learn effectively. We also introduce a reduced-order method called the physics-informed Karhunen-Lo\\`eve expansion (PICKLE), which combines model reduction techniques with physics-informed machine learning to efficiently solve space-time-dependent PDE problems. A key advantage of these two methods is their ability to seamlessly assimilate additional data, which can enhance model training and improve predictive accuracy. Additionally, we propose reduced-order neural operator surrogate models, including KL-DNN and VAE-DNN, which employ the dimension reduction technique to identify low-dimensional subspaces and construct operator-based mappings between PDE parameters and solutions. These surrogate models offer significant computational and energy efficiency, as they can be trained in separate components while maintaining accuracy comparable to state-of-the-art neural operators such as the Fourier Neural Operator. The second objective is to develop scalable UQ methods to address the challenges posed by complex posterior distributions in high-dimensional, PDE-constrained inverse problems. These problems are often affected by the CoD and exhibit pathological behaviors in high-dimensional probability spaces, making existing Bayesian inference computationally demanding. We propose a Bayesian UQ framework based on the randomize-then-optimize approach, which enables efficient posterior sampling by tailoring the optimization process to the loss functions of our physics-informed machine learning models, including PINN and PICKLE. The third objective is to develop effective digital twins capable of accurately and rapidly predicting PDE solutions under a wide range of control variables while remaining differentiable with respect to them. To achieve this, we integrate the proposed neural operator-based surrogate models with transfer learning techniques, allowing models trained on one set of conditions to generalize efficiently to new scenarios with minimal retraining. Additionally, we provide a rigorous mathematical analysis of the transferability of these surrogate models for both linear and nonlinear PDEs. This thesis outlines a comprehensive roadmap for advancing physics-informed machine learning techniques. We present numerical results for each objective, demonstrating their effectiveness and laying the foundation for broader applications toward large, real-world problems."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/129437"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Yifei Zong"],"dc:subject":["Physics-informed Machine Learning","Environmental Modeling","Uncertainty Quantification"],"dc:title":["Physics-informed machine learning methods for environmental modeling and uncertainty quantification"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Civil Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:05Z"}