{"id":{"repo_id":"cambridge","oai_identifier":"oai:www.repository.cam.ac.uk:1810/374873"},"canonical_url":"https://search.dev.ndltd.org/etd/cambridge/oai:www.repository.cam.ac.uk:1810/374873","repository":{"repo_id":"cambridge","name":"Cambridge University","base_url":"https://api.repository.cam.ac.uk/server/oai/request"},"display":{"title":"Improved Gaussian process approximations for spatial and flow fields","abstract":"Many modelling problems in scientific and engineering applications require quantitative models of uncertainty, for example to appropriately weight different sources of information, or to make risk-aware decisions. A natural way to formalise this is as a probabilistic model with a Bayesian point of view. When the main object of interest is a function - such as a spatial or flow field - Gaussian processes (GPs) are suitable probabilistic models. These can incorporate expert knowledge (priors), and data can be used to learn the model parameters. The cost of learning is high, motivating approximations, most notably variational approximations. This thesis improves on variational GP approximations in different settings. Firstly, I consider approximate learning of low dimensional spatial fields. In Chapter 2, I argue for precomputable variational approximations, which only access the training data once during learning. These lead to significant computational savings, but are limited to an excessively narrow class of priors. In Chapter 3, I develop a class of precomputable approximations which first replace the prior with a periodic approximation. These approximate Fourier series methods outperform existing methods, have compelling theoretical guarantees, and are applicable to a broad class of priors - stationary priors whose covariance functions have well-defined spectral densities. Since many spatial fields are highly non-stationary, in Chapter 4 I construct a new class of non-stationary priors based on multiresolution (discrete wavelet) approximations, with a compatible precomputable approximation. In Chapter 5 I turn to modelling flow fields for system identification problems. Here I propose a new approach - approximating the state posterior with Kalman smoothing - leading to faster and less biased learning, while also applicable to either discrete or continuous time. Overall, this thesis presents improved GP variational approximations to make learning cheaper, with applicability to a broader class of priors, supported by a mix of theoretical guarantees and empirical evaluation.","abstract_html":"Many modelling problems in scientific and engineering applications require quantitative models of uncertainty, for example to appropriately weight different sources of information, or to make risk-aware decisions. A natural way to formalise this is as a probabilistic model with a Bayesian point of view. When the main object of interest is a function - such as a spatial or flow field - Gaussian processes (GPs) are suitable probabilistic models. These can incorporate expert knowledge (priors), and data can be used to learn the model parameters. The cost of learning is high, motivating approximations, most notably variational approximations. This thesis improves on variational GP approximations in different settings. Firstly, I consider approximate learning of low dimensional spatial fields. In Chapter 2, I argue for precomputable variational approximations, which only access the training data once during learning. These lead to significant computational savings, but are limited to an excessively narrow class of priors. In Chapter 3, I develop a class of precomputable approximations which first replace the prior with a periodic approximation. These approximate Fourier series methods outperform existing methods, have compelling theoretical guarantees, and are applicable to a broad class of priors - stationary priors whose covariance functions have well-defined spectral densities. Since many spatial fields are highly non-stationary, in Chapter 4 I construct a new class of non-stationary priors based on multiresolution (discrete wavelet) approximations, with a compatible precomputable approximation. In Chapter 5 I turn to modelling flow fields for system identification problems. Here I propose a new approach - approximating the state posterior with Kalman smoothing - leading to faster and less biased learning, while also applicable to either discrete or continuous time. Overall, this thesis presents improved GP variational approximations to make learning cheaper, with applicability to a broader class of priors, supported by a mix of theoretical guarantees and empirical evaluation.","abstract_has_math":false,"creators":["Cheema, Talay"],"institution":"University of Cambridge","degree_name":"Doctor of Philosophy (PhD)","degree_level":"Doctoral","degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":["Rasmussen, Carl"],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-03-15","date_published":"2024-03-15","updated_at":"2026-07-22T22:24:31Z","subjects":["Dynamical systems","Gaussian processes","Machine learning"],"languages":["eng"],"rights":[],"rights_urls":["https://apollo8-f-pro.lib.cam.ac.uk/bitstreams/032e81e5-4a04-4ccb-aa9d-6820fbb6b54e/download","https://www.rioxx.net/licenses/all-rights-reserved/"],"identifier_entries":[]},"links":{"outbound_url":"https://doi.org/10.17863/CAM.112770","outbound_label":"DOI","outbound_source":"dc:identifier.doi"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Rasmussen, Carl"]},{"key":"dc:contributor.sponsor","label":"Sponsor","values":["Bill Brown Fund"]},{"key":"dc:creator","label":"Author","values":["Cheema, Talay"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.issued","label":"Date","values":["2024-03-15"]},{"key":"dc:publisher.institution","label":"Dc Publisher Institution","values":["University of Cambridge"]},{"key":"dc:relation.isreferencedby.uri","label":"Dc Relation Isreferencedby URI","values":["https://www.repository.cam.ac.uk/handle/1810/374873"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"dc:type.qualificationlevel","label":"Dc Type Qualificationlevel","values":["Doctoral"]},{"key":"dc:type.qualificationname","label":"Dc Type Qualificationname","values":["Doctor of Philosophy (PhD)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Dynamical systems","Gaussian processes","Machine learning"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["https://apollo8-f-pro.lib.cam.ac.uk/bitstreams/032e81e5-4a04-4ccb-aa9d-6820fbb6b54e/download","https://www.rioxx.net/licenses/all-rights-reserved/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.17863/CAM.112770"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://apollo8-f-pro.lib.cam.ac.uk/bitstreams/419c1da6-c9e6-49c3-9d79-55342ee2d69a/download"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Many modelling problems in scientific and engineering applications require quantitative models of uncertainty, for example to appropriately weight different sources of information, or to make risk-aware decisions. A natural way to formalise this is as a probabilistic model with a Bayesian point of view. When the main object of interest is a function - such as a spatial or flow field - Gaussian processes (GPs) are suitable probabilistic models. These can incorporate expert knowledge (priors), and data can be used to learn the model parameters. The cost of learning is high, motivating approximations, most notably variational approximations. This thesis improves on variational GP approximations in different settings. Firstly, I consider approximate learning of low dimensional spatial fields. In Chapter 2, I argue for precomputable variational approximations, which only access the training data once during learning. These lead to significant computational savings, but are limited to an excessively narrow class of priors. In Chapter 3, I develop a class of precomputable approximations which first replace the prior with a periodic approximation. These approximate Fourier series methods outperform existing methods, have compelling theoretical guarantees, and are applicable to a broad class of priors - stationary priors whose covariance functions have well-defined spectral densities. Since many spatial fields are highly non-stationary, in Chapter 4 I construct a new class of non-stationary priors based on multiresolution (discrete wavelet) approximations, with a compatible precomputable approximation. In Chapter 5 I turn to modelling flow fields for system identification problems. Here I propose a new approach - approximating the state posterior with Kalman smoothing - leading to faster and less biased learning, while also applicable to either discrete or continuous time. Overall, this thesis presents improved GP variational approximations to make learning cheaper, with applicability to a broader class of priors, supported by a mix of theoretical guarantees and empirical evaluation."]},{"key":"dc:format.checksum.md5","label":"Dc Format Checksum Md5","values":["1491348d6aa836835e2cf2200244a6c4","87eda9de84448d1f82354d60eee3eb5f"]},{"key":"dc:title","label":"Title","values":["Improved Gaussian process approximations for spatial and flow fields"]}]}],"canonical_facts":{"dc:contributor.advisor":["Rasmussen, Carl"],"dc:contributor.sponsor":["Bill Brown Fund"],"dc:creator":["Cheema, Talay"],"dc:date.issued":["2024-03-15"],"dc:description.abstract":["Many modelling problems in scientific and engineering applications require quantitative models of uncertainty, for example to appropriately weight different sources of information, or to make risk-aware decisions. A natural way to formalise this is as a probabilistic model with a Bayesian point of view. When the main object of interest is a function - such as a spatial or flow field - Gaussian processes (GPs) are suitable probabilistic models. These can incorporate expert knowledge (priors), and data can be used to learn the model parameters. The cost of learning is high, motivating approximations, most notably variational approximations. This thesis improves on variational GP approximations in different settings. Firstly, I consider approximate learning of low dimensional spatial fields. In Chapter 2, I argue for precomputable variational approximations, which only access the training data once during learning. These lead to significant computational savings, but are limited to an excessively narrow class of priors. In Chapter 3, I develop a class of precomputable approximations which first replace the prior with a periodic approximation. These approximate Fourier series methods outperform existing methods, have compelling theoretical guarantees, and are applicable to a broad class of priors - stationary priors whose covariance functions have well-defined spectral densities. Since many spatial fields are highly non-stationary, in Chapter 4 I construct a new class of non-stationary priors based on multiresolution (discrete wavelet) approximations, with a compatible precomputable approximation. In Chapter 5 I turn to modelling flow fields for system identification problems. Here I propose a new approach - approximating the state posterior with Kalman smoothing - leading to faster and less biased learning, while also applicable to either discrete or continuous time. Overall, this thesis presents improved GP variational approximations to make learning cheaper, with applicability to a broader class of priors, supported by a mix of theoretical guarantees and empirical evaluation."],"dc:format.checksum.md5":["1491348d6aa836835e2cf2200244a6c4","87eda9de84448d1f82354d60eee3eb5f"],"dc:identifier.doi":["https://doi.org/10.17863/CAM.112770"],"dc:identifier.uri":["https://apollo8-f-pro.lib.cam.ac.uk/bitstreams/419c1da6-c9e6-49c3-9d79-55342ee2d69a/download"],"dc:language":["eng"],"dc:publisher.institution":["University of Cambridge"],"dc:relation.isreferencedby.uri":["https://www.repository.cam.ac.uk/handle/1810/374873"],"dc:rights":["https://apollo8-f-pro.lib.cam.ac.uk/bitstreams/032e81e5-4a04-4ccb-aa9d-6820fbb6b54e/download","https://www.rioxx.net/licenses/all-rights-reserved/"],"dc:subject":["Dynamical systems","Gaussian processes","Machine learning"],"dc:title":["Improved Gaussian process approximations for spatial and flow fields"],"dc:type":["Thesis"],"dc:type.qualificationlevel":["Doctoral"],"dc:type.qualificationname":["Doctor of Philosophy (PhD)"]},"updated_at":"2026-07-22T22:24:31Z"}