{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/109397"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/109397","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Nonlinear filtering of high dimensional, chaotic, multiple timescale correlated systems","abstract":"This dissertation addresses theoretical and numerical questions in nonlinear filtering theory for high dimensional, chaotic, multiple timescale correlated systems. The research is motivated by problems in the geosciences, in particular oceanic or atmospheric estimation and climate prediction. As the capability and need to further resolve the physics models on finer scales continues, greater spatial and temporal scales become present and the dimension of the models becomes increasingly large. In the atmospheric sciences, these models can be of the order $\\mathcal{O}(10^9)$ degrees of freedom and require assimilation of the order $\\mathcal{O}(10^7)$ observations during a single day. The models are chaotic and the observing sensors may be correlated with the physical processes themselves. The goal of the dissertation is to develop theoretical results that can provide the mathematical justification for new filtering algorithms on a lower dimensional problem, and to develop novel methods for dealing with issues that plague particle filtering when applied to high dimensional, chaotic, multiple timescale correlated systems. The first half of the dissertation is theoretical and addresses the question of approximating the continuous time nonlinear filtering equation for a multiple timescale correlated system by an averaged filtering equation in the limit of large timescale separation. The first result in this direction is within the context of a slow-fast system with correlation between the slow process and the observation process, and when we are only interested in estimating functions of the slow process. The main result is that we can retrieve a rate of convergence and that there is a metric generating the topology of weak convergence, such that the marginal filter converges to the averaged filter at the given rate in the limit of large timescale separation. The proof uses a probabilistic representation (backward doubly stochastic differential equation) of the dual process to the unnormalized filter, and sharp estimates on the transition density and semigroup of the fast process. The second theoretical result of the dissertation addresses the same question for a broader problem, where the slow signal dynamics include an intermediate timescale forcing. We prove that the marginal filter converges in probability to the average filter for a metric that generates the topology of weak convergence. The method of proof is by showing tightness of the measure-valued process, characterizing the weak limits, and proving the limit is unique. The perturbation test function (also known as method of corrector) is used to deal with the intermediate timescale forcing term, where the corrector is the solution of a Poisson equation. The second half of the dissertation develops filtering algorithms that leverage the theoretical results from the first half of the thesis to produce particle filtering methods for the averaged filtering equation. We also develop particle methods that address the issue of particle collapse for filtering on general high dimensional chaotic systems. Using the two timescale Lorenz 1996 atmospheric model, we show that the reduced order particle filtering methods are shown to be at least an order of magnitude faster than standard particle methods. We develop a method for particle filtering when the signal and observation processes are correlated. We also develop extensions to controlled optimal proposal particle filters that improve the diversity of the particle ensemble when tested on the Lorenz 1963 model. In the last chapter of the dissertation, we adopt a dynamical systems viewpoint to address the issue of particle collapse. This time the goal is to exploit the chaotic properties of the system being filtered to perform assimilation in a lower dimensional subspace. A new approach is developed which enables data assimilation in the unstable subspace for particle filtering. We introduce the idea of future right-singular vectors to produce projection operators, enabling assimilation in a lower dimensional subspace. We show that particle filtering algorithms using dynamically generator projection operators, in particular the future right-singular vectors, outperforms standard particle methods in terms of root-mean-square-error, diversity of the particle ensemble, and robustness when applied to the single timescale Lorenz 1996 model.","abstract_html":"This dissertation addresses theoretical and numerical questions in nonlinear filtering theory for high dimensional, chaotic, multiple timescale correlated systems. The research is motivated by problems in the geosciences, in particular oceanic or atmospheric estimation and climate prediction. As the capability and need to further resolve the physics models on finer scales continues, greater spatial and temporal scales become present and the dimension of the models becomes increasingly large. In the atmospheric sciences, these models can be of the order <span class=\"etd-inline-math\">\\mathcal{O}(10<sup>9</sup>)</span> degrees of freedom and require assimilation of the order <span class=\"etd-inline-math\">\\mathcal{O}(10<sup>7</sup>)</span> observations during a single day. The models are chaotic and the observing sensors may be correlated with the physical processes themselves. The goal of the dissertation is to develop theoretical results that can provide the mathematical justification for new filtering algorithms on a lower dimensional problem, and to develop novel methods for dealing with issues that plague particle filtering when applied to high dimensional, chaotic, multiple timescale correlated systems. The first half of the dissertation is theoretical and addresses the question of approximating the continuous time nonlinear filtering equation for a multiple timescale correlated system by an averaged filtering equation in the limit of large timescale separation. The first result in this direction is within the context of a slow-fast system with correlation between the slow process and the observation process, and when we are only interested in estimating functions of the slow process. The main result is that we can retrieve a rate of convergence and that there is a metric generating the topology of weak convergence, such that the marginal filter converges to the averaged filter at the given rate in the limit of large timescale separation. The proof uses a probabilistic representation (backward doubly stochastic differential equation) of the dual process to the unnormalized filter, and sharp estimates on the transition density and semigroup of the fast process. The second theoretical result of the dissertation addresses the same question for a broader problem, where the slow signal dynamics include an intermediate timescale forcing. We prove that the marginal filter converges in probability to the average filter for a metric that generates the topology of weak convergence. The method of proof is by showing tightness of the measure-valued process, characterizing the weak limits, and proving the limit is unique. The perturbation test function (also known as method of corrector) is used to deal with the intermediate timescale forcing term, where the corrector is the solution of a Poisson equation. The second half of the dissertation develops filtering algorithms that leverage the theoretical results from the first half of the thesis to produce particle filtering methods for the averaged filtering equation. We also develop particle methods that address the issue of particle collapse for filtering on general high dimensional chaotic systems. Using the two timescale Lorenz 1996 atmospheric model, we show that the reduced order particle filtering methods are shown to be at least an order of magnitude faster than standard particle methods. We develop a method for particle filtering when the signal and observation processes are correlated. We also develop extensions to controlled optimal proposal particle filters that improve the diversity of the particle ensemble when tested on the Lorenz 1963 model. In the last chapter of the dissertation, we adopt a dynamical systems viewpoint to address the issue of particle collapse. This time the goal is to exploit the chaotic properties of the system being filtered to perform assimilation in a lower dimensional subspace. A new approach is developed which enables data assimilation in the unstable subspace for particle filtering. We introduce the idea of future right-singular vectors to produce projection operators, enabling assimilation in a lower dimensional subspace. We show that particle filtering algorithms using dynamically generator projection operators, in particular the future right-singular vectors, outperforms standard particle methods in terms of root-mean-square-error, diversity of the particle ensemble, and robustness when applied to the single timescale Lorenz 1996 model.","abstract_has_math":true,"creators":["Beeson, Ryne T"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Aerospace Engineering","degree_department":null,"school":null,"contributors":["Namachchivaya, Navaratnam S","Conway, Bruce","Perkowski, Nicolas","Rapti, Zoi","Song, Renming"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-03-05T21:38:09Z","date_published":"2021-03-05T21:38:09Z","updated_at":"2026-07-22T22:24:50Z","subjects":["nonlinear filtering","particle filtering","sequential Monte Carlo","reduced order filter","multiple timescale","correlated noise","optimal proposal","assimilation in the unstable subspace","future right-singular vectors","Lorenz 1996","Lorenz 1963"],"languages":["en"],"rights":["Copyright 2020 Ryne Beeson"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/109397","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Namachchivaya, Navaratnam S","Conway, Bruce","Perkowski, Nicolas","Rapti, Zoi","Song, Renming"]},{"key":"dc:creator","label":"Author","values":["Beeson, Ryne T"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-03-05T21:38:09Z","2020-12-01","2020-12"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Aerospace Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["nonlinear filtering","particle filtering","sequential Monte Carlo","reduced order filter","multiple timescale","correlated noise","optimal proposal","assimilation in the unstable subspace","future right-singular vectors","Lorenz 1996","Lorenz 1963"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2020 Ryne Beeson"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/109397"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This dissertation addresses theoretical and numerical questions in nonlinear filtering theory for high dimensional, chaotic, multiple timescale correlated systems. The research is motivated by problems in the geosciences, in particular oceanic or atmospheric estimation and climate prediction. As the capability and need to further resolve the physics models on finer scales continues, greater spatial and temporal scales become present and the dimension of the models becomes increasingly large. In the atmospheric sciences, these models can be of the order $\\mathcal{O}(10^9)$ degrees of freedom and require assimilation of the order $\\mathcal{O}(10^7)$ observations during a single day. The models are chaotic and the observing sensors may be correlated with the physical processes themselves. The goal of the dissertation is to develop theoretical results that can provide the mathematical justification for new filtering algorithms on a lower dimensional problem, and to develop novel methods for dealing with issues that plague particle filtering when applied to high dimensional, chaotic, multiple timescale correlated systems. The first half of the dissertation is theoretical and addresses the question of approximating the continuous time nonlinear filtering equation for a multiple timescale correlated system by an averaged filtering equation in the limit of large timescale separation. The first result in this direction is within the context of a slow-fast system with correlation between the slow process and the observation process, and when we are only interested in estimating functions of the slow process. The main result is that we can retrieve a rate of convergence and that there is a metric generating the topology of weak convergence, such that the marginal filter converges to the averaged filter at the given rate in the limit of large timescale separation. The proof uses a probabilistic representation (backward doubly stochastic differential equation) of the dual process to the unnormalized filter, and sharp estimates on the transition density and semigroup of the fast process. The second theoretical result of the dissertation addresses the same question for a broader problem, where the slow signal dynamics include an intermediate timescale forcing. We prove that the marginal filter converges in probability to the average filter for a metric that generates the topology of weak convergence. The method of proof is by showing tightness of the measure-valued process, characterizing the weak limits, and proving the limit is unique. The perturbation test function (also known as method of corrector) is used to deal with the intermediate timescale forcing term, where the corrector is the solution of a Poisson equation. The second half of the dissertation develops filtering algorithms that leverage the theoretical results from the first half of the thesis to produce particle filtering methods for the averaged filtering equation. We also develop particle methods that address the issue of particle collapse for filtering on general high dimensional chaotic systems. Using the two timescale Lorenz 1996 atmospheric model, we show that the reduced order particle filtering methods are shown to be at least an order of magnitude faster than standard particle methods. We develop a method for particle filtering when the signal and observation processes are correlated. We also develop extensions to controlled optimal proposal particle filters that improve the diversity of the particle ensemble when tested on the Lorenz 1963 model. In the last chapter of the dissertation, we adopt a dynamical systems viewpoint to address the issue of particle collapse. This time the goal is to exploit the chaotic properties of the system being filtered to perform assimilation in a lower dimensional subspace. A new approach is developed which enables data assimilation in the unstable subspace for particle filtering. We introduce the idea of future right-singular vectors to produce projection operators, enabling assimilation in a lower dimensional subspace. We show that particle filtering algorithms using dynamically generator projection operators, in particular the future right-singular vectors, outperforms standard particle methods in terms of root-mean-square-error, diversity of the particle ensemble, and robustness when applied to the single timescale Lorenz 1996 model.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2021-03-04 without embargo terms","The student, Ryne Beeson, accepted the attached license on 2020-11-30 at 10:24.","The student, Ryne Beeson, submitted this Dissertation for approval on 2020-11-30 at 10:35.","This Dissertation was approved for publication on 2020-12-01 at 16:36.","DSpace SAF Submission Ingestion Package generated from Vireo submission #15983 on 2021-03-04 at 15:35:14","Made available in DSpace on 2021-03-05T21:38:09Z (GMT). No. of bitstreams: 3 BEESON-DISSERTATION-2020.pdf: 11117355 bytes, checksum: 46a273427520996f4b29bc2f71d1289d (MD5) LICENSE.txt: 4208 bytes, checksum: 08f0588563b171e6623486a6f781c14d (MD5) PROQUEST_LICENSE.txt: 4554 bytes, checksum: fa53aba470b0a897b44d9e65b1f46699 (MD5) Previous issue date: 2020-12-01"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Nonlinear filtering of high dimensional, chaotic, multiple timescale correlated systems"]}]}],"canonical_facts":{"dc:contributor":["Namachchivaya, Navaratnam S","Conway, Bruce","Perkowski, Nicolas","Rapti, Zoi","Song, Renming"],"dc:creator":["Beeson, Ryne T"],"dc:date":["2021-03-05T21:38:09Z","2020-12-01","2020-12"],"dc:description":["This dissertation addresses theoretical and numerical questions in nonlinear filtering theory for high dimensional, chaotic, multiple timescale correlated systems. The research is motivated by problems in the geosciences, in particular oceanic or atmospheric estimation and climate prediction. As the capability and need to further resolve the physics models on finer scales continues, greater spatial and temporal scales become present and the dimension of the models becomes increasingly large. In the atmospheric sciences, these models can be of the order $\\mathcal{O}(10^9)$ degrees of freedom and require assimilation of the order $\\mathcal{O}(10^7)$ observations during a single day. The models are chaotic and the observing sensors may be correlated with the physical processes themselves. The goal of the dissertation is to develop theoretical results that can provide the mathematical justification for new filtering algorithms on a lower dimensional problem, and to develop novel methods for dealing with issues that plague particle filtering when applied to high dimensional, chaotic, multiple timescale correlated systems. The first half of the dissertation is theoretical and addresses the question of approximating the continuous time nonlinear filtering equation for a multiple timescale correlated system by an averaged filtering equation in the limit of large timescale separation. The first result in this direction is within the context of a slow-fast system with correlation between the slow process and the observation process, and when we are only interested in estimating functions of the slow process. The main result is that we can retrieve a rate of convergence and that there is a metric generating the topology of weak convergence, such that the marginal filter converges to the averaged filter at the given rate in the limit of large timescale separation. The proof uses a probabilistic representation (backward doubly stochastic differential equation) of the dual process to the unnormalized filter, and sharp estimates on the transition density and semigroup of the fast process. The second theoretical result of the dissertation addresses the same question for a broader problem, where the slow signal dynamics include an intermediate timescale forcing. We prove that the marginal filter converges in probability to the average filter for a metric that generates the topology of weak convergence. The method of proof is by showing tightness of the measure-valued process, characterizing the weak limits, and proving the limit is unique. The perturbation test function (also known as method of corrector) is used to deal with the intermediate timescale forcing term, where the corrector is the solution of a Poisson equation. The second half of the dissertation develops filtering algorithms that leverage the theoretical results from the first half of the thesis to produce particle filtering methods for the averaged filtering equation. We also develop particle methods that address the issue of particle collapse for filtering on general high dimensional chaotic systems. Using the two timescale Lorenz 1996 atmospheric model, we show that the reduced order particle filtering methods are shown to be at least an order of magnitude faster than standard particle methods. We develop a method for particle filtering when the signal and observation processes are correlated. We also develop extensions to controlled optimal proposal particle filters that improve the diversity of the particle ensemble when tested on the Lorenz 1963 model. In the last chapter of the dissertation, we adopt a dynamical systems viewpoint to address the issue of particle collapse. This time the goal is to exploit the chaotic properties of the system being filtered to perform assimilation in a lower dimensional subspace. A new approach is developed which enables data assimilation in the unstable subspace for particle filtering. We introduce the idea of future right-singular vectors to produce projection operators, enabling assimilation in a lower dimensional subspace. We show that particle filtering algorithms using dynamically generator projection operators, in particular the future right-singular vectors, outperforms standard particle methods in terms of root-mean-square-error, diversity of the particle ensemble, and robustness when applied to the single timescale Lorenz 1996 model.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2021-03-04 without embargo terms","The student, Ryne Beeson, accepted the attached license on 2020-11-30 at 10:24.","The student, Ryne Beeson, submitted this Dissertation for approval on 2020-11-30 at 10:35.","This Dissertation was approved for publication on 2020-12-01 at 16:36.","DSpace SAF Submission Ingestion Package generated from Vireo submission #15983 on 2021-03-04 at 15:35:14","Made available in DSpace on 2021-03-05T21:38:09Z (GMT). No. of bitstreams: 3 BEESON-DISSERTATION-2020.pdf: 11117355 bytes, checksum: 46a273427520996f4b29bc2f71d1289d (MD5) LICENSE.txt: 4208 bytes, checksum: 08f0588563b171e6623486a6f781c14d (MD5) PROQUEST_LICENSE.txt: 4554 bytes, checksum: fa53aba470b0a897b44d9e65b1f46699 (MD5) Previous issue date: 2020-12-01"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/109397"],"dc:language":["en"],"dc:rights":["Copyright 2020 Ryne Beeson"],"dc:subject":["nonlinear filtering","particle filtering","sequential Monte Carlo","reduced order filter","multiple timescale","correlated noise","optimal proposal","assimilation in the unstable subspace","future right-singular vectors","Lorenz 1996","Lorenz 1963"],"dc:title":["Nonlinear filtering of high dimensional, chaotic, multiple timescale correlated systems"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Aerospace Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:50Z"}