{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/124378"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/124378","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"On representations of differential equations for state space statistical forecasting","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","abstract_has_math":false,"creators":["Naumer, Helmuth J"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Kamalabadi, Farzad","Raginsky, Maxim","Srikant, Rayadurgam","Banerjee, Arindam"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-05","date_published":"2024-05","updated_at":"2026-07-22T22:25:00Z","subjects":["Statistical Inference","Estimation Theory","Dynamic Systems","Differential Equations"],"languages":["en","eng"],"rights":["Copyright 2024 Helmuth Naumer"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/124378","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Kamalabadi, Farzad","Raginsky, Maxim","Srikant, Rayadurgam","Banerjee, Arindam"]},{"key":"dc:creator","label":"Author","values":["Naumer, Helmuth J"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-05","2024-04-24"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Statistical Inference","Estimation Theory","Dynamic Systems","Differential Equations"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Helmuth Naumer"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/124378"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","The student, Helmuth Naumer, accepted the attached license on 2024-04-23 at 11:41.","The student, Helmuth Naumer, submitted this Dissertation for approval on 2024-04-23 at 12:03.","This Dissertation was approved for publication on 2024-04-24 at 10:06.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20571 on 2024-09-16 at 00:35:57","The key to understanding the statistical limitations of a problem is often in finding the right representation of the space. Under sub-optimal representations, guarantees on the performance of an estimator can be too loose or even seemingly contradictory due to the inherently local nature of frequentist statistics. This work investigates several interconnected problems in forecasting dynamical systems: seeking to use different parameterizations of the system to provide strong statistical guarantees on the underlying families of probability distributions and to complete a detailed analysis of specific estimators applied to the problem. We begin this work with a focus on linear space-invariant spatiotemporal processes. When observations are made at discrete time steps, we identify statistical guarantees around a grid-based approximation of an inherently continuous system defined by a partial differential equation (PDE). In particular, by applying a Fourier transform to the grid approximation, we provide guarantees on the performance of the Kalman filter under mismatched model assumptions, as well as the least-squares estimator of the underlying state-transition operator. Many generalizations of the core analysis are outlined throughout the chapter, including an extension to piecewise constant dynamics. The second focus of this work is on deterministic nonlinear ordinary differential equations (ODEs) under noisy observations. Assuming Lipschitz continuity of the differential equation, we demonstrate that the set of trajectories of a system form a manifold where each trajectory corresponds to a single point. This realization motivates a collection of different perspectives on the forecasting problem based on properties of different time horizons. By considering the family of observations to be parameterized by the state of the system, we prove the often contradictory behavior of the infinitely large Cramér–Rao lower bound in the neighborhood of repelling points, as well as the dimensionality reduction inherent in convergence to low-dimensional attractors. We furthermore demonstrate two concrete algorithms enabled by these observations: multiple shrinkage estimators to stabilize error in the neighborhood of the unstable equilibria and a sequential optimal experimental design policy for infinite-horizon forecasting. Finally, we conclude with an investigation into the prediction of the formation of shocks in PDEs based on noisy measurements of boundary conditions. As shocks, or discontinuities in the solutions of PDEs, are particularly poorly behaved mathematical structures, we introduce a sequence of relaxations of the prediction problem. By instead looking at the variation within epsilon-balls, we propose a Monte Carlo method to quantify the probability of observing a discontinuity. Under a conjecture on the behavior of shocks, the proposed algorithm converges to a function analogous to an arrival rate in a point process. The behavior is verified in simulation using Burgers' Equation. This dissertation creates a solid foundation for the future study of statistical forecasting with differential equation governed systems. This work provides an analysis of various representations of the observation process in state-space models, as well as a methodology to construct new estimation techniques and bounds. The proposed methods emphasize the geometry of the space of solutions and thus are equally applicable to Bayesian and Frequentist methods in statistics."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["On representations of differential equations for state space statistical forecasting"]}]}],"canonical_facts":{"dc:contributor":["Kamalabadi, Farzad","Raginsky, Maxim","Srikant, Rayadurgam","Banerjee, Arindam"],"dc:creator":["Naumer, Helmuth J"],"dc:date":["2024-05","2024-04-24"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","The student, Helmuth Naumer, accepted the attached license on 2024-04-23 at 11:41.","The student, Helmuth Naumer, submitted this Dissertation for approval on 2024-04-23 at 12:03.","This Dissertation was approved for publication on 2024-04-24 at 10:06.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20571 on 2024-09-16 at 00:35:57","The key to understanding the statistical limitations of a problem is often in finding the right representation of the space. Under sub-optimal representations, guarantees on the performance of an estimator can be too loose or even seemingly contradictory due to the inherently local nature of frequentist statistics. This work investigates several interconnected problems in forecasting dynamical systems: seeking to use different parameterizations of the system to provide strong statistical guarantees on the underlying families of probability distributions and to complete a detailed analysis of specific estimators applied to the problem. We begin this work with a focus on linear space-invariant spatiotemporal processes. When observations are made at discrete time steps, we identify statistical guarantees around a grid-based approximation of an inherently continuous system defined by a partial differential equation (PDE). In particular, by applying a Fourier transform to the grid approximation, we provide guarantees on the performance of the Kalman filter under mismatched model assumptions, as well as the least-squares estimator of the underlying state-transition operator. Many generalizations of the core analysis are outlined throughout the chapter, including an extension to piecewise constant dynamics. The second focus of this work is on deterministic nonlinear ordinary differential equations (ODEs) under noisy observations. Assuming Lipschitz continuity of the differential equation, we demonstrate that the set of trajectories of a system form a manifold where each trajectory corresponds to a single point. This realization motivates a collection of different perspectives on the forecasting problem based on properties of different time horizons. By considering the family of observations to be parameterized by the state of the system, we prove the often contradictory behavior of the infinitely large Cramér–Rao lower bound in the neighborhood of repelling points, as well as the dimensionality reduction inherent in convergence to low-dimensional attractors. We furthermore demonstrate two concrete algorithms enabled by these observations: multiple shrinkage estimators to stabilize error in the neighborhood of the unstable equilibria and a sequential optimal experimental design policy for infinite-horizon forecasting. Finally, we conclude with an investigation into the prediction of the formation of shocks in PDEs based on noisy measurements of boundary conditions. As shocks, or discontinuities in the solutions of PDEs, are particularly poorly behaved mathematical structures, we introduce a sequence of relaxations of the prediction problem. By instead looking at the variation within epsilon-balls, we propose a Monte Carlo method to quantify the probability of observing a discontinuity. Under a conjecture on the behavior of shocks, the proposed algorithm converges to a function analogous to an arrival rate in a point process. The behavior is verified in simulation using Burgers' Equation. This dissertation creates a solid foundation for the future study of statistical forecasting with differential equation governed systems. This work provides an analysis of various representations of the observation process in state-space models, as well as a methodology to construct new estimation techniques and bounds. The proposed methods emphasize the geometry of the space of solutions and thus are equally applicable to Bayesian and Frequentist methods in statistics."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/124378"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Helmuth Naumer"],"dc:subject":["Statistical Inference","Estimation Theory","Dynamic Systems","Differential Equations"],"dc:title":["On representations of differential equations for state space statistical forecasting"],"dc:type":["text"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:00Z"}