{"id":{"repo_id":"cambridge","oai_identifier":"oai:www.repository.cam.ac.uk:1810/398241"},"canonical_url":"https://search.dev.ndltd.org/etd/cambridge/oai:www.repository.cam.ac.uk:1810/398241","repository":{"repo_id":"cambridge","name":"Cambridge University","base_url":"https://api.repository.cam.ac.uk/server/oai/request"},"display":{"title":"Continuous Representations in Machine Learning - With applications to medical imaging and operator learning","abstract":"Machine learning has led to significant advancements in many areas of our everyday lives, in addition to various fields in science. Machine and particularly deep learning methods have been used for applications such as protein structure prediction, drug discovery, climate modelling and medical imaging. Despite their successes, fundamental challenges remain regarding their theoretical understanding and interpretability, generalisation capabilities particularly in low data regimes, robustness to noise and training in restricted resource settings. Many real-world observations can naturally be described as continuous processes rather than discrete data points -- making their data inherently continuous. Consequently, in recent years, the deep learning research community has increasingly explored continuous representations, which refer to both continuous representations of data and neural networks. They enable resolution independent evaluation, as well as physics-informed and geometry-aware learning. In this thesis, the implications of continuous representations on open questions in machine learning research are investigated. We explore theoretical understanding, generalisation capabilities, robustness to noise, training in restricted resource settings and learning on arbitrary geometries. We show that continuous representations enable theoretical insights and improve interpretability by leveraging findings from well-established fields like ordinary differential equation theory. Through numerical experiments in the field of operator learning, we demonstrate that continuous representations improve generalisation, particularly in low data regimes, and provide theoretical and numerical insights into adaptive sampling strategies for continuous representations of neural networks. Furthermore, we demonstrate their robustness against noise, making them particularly well-suited for medical imaging, a field often challenged by significant noise levels. While neural networks are becoming increasingly more expressive and their number of parameters increases, their training and inference also becomes more and more challenging due to greater computational and memory costs. Thus, we propose a method to reduce memory and computational requirements during inference without the need to retrain the model. Additionally, owing to the resolution-invariant evaluation capability of continuous representations, we show that continuous representations enable efficient inference across varying resolutions. In the context of learning on irregular domains, we introduce a technique for operator learning on arbitrary geometries. As machine learning advances, continuous representations provide a powerful and flexible framework that addresses fundamental open questions in the field and promises to redefine current boundaries.","abstract_html":"Machine learning has led to significant advancements in many areas of our everyday lives, in addition to various fields in science. Machine and particularly deep learning methods have been used for applications such as protein structure prediction, drug discovery, climate modelling and medical imaging. Despite their successes, fundamental challenges remain regarding their theoretical understanding and interpretability, generalisation capabilities particularly in low data regimes, robustness to noise and training in restricted resource settings. Many real-world observations can naturally be described as continuous processes rather than discrete data points -- making their data inherently continuous. Consequently, in recent years, the deep learning research community has increasingly explored continuous representations, which refer to both continuous representations of data and neural networks. They enable resolution independent evaluation, as well as physics-informed and geometry-aware learning. In this thesis, the implications of continuous representations on open questions in machine learning research are investigated. We explore theoretical understanding, generalisation capabilities, robustness to noise, training in restricted resource settings and learning on arbitrary geometries. We show that continuous representations enable theoretical insights and improve interpretability by leveraging findings from well-established fields like ordinary differential equation theory. Through numerical experiments in the field of operator learning, we demonstrate that continuous representations improve generalisation, particularly in low data regimes, and provide theoretical and numerical insights into adaptive sampling strategies for continuous representations of neural networks. Furthermore, we demonstrate their robustness against noise, making them particularly well-suited for medical imaging, a field often challenged by significant noise levels. While neural networks are becoming increasingly more expressive and their number of parameters increases, their training and inference also becomes more and more challenging due to greater computational and memory costs. Thus, we propose a method to reduce memory and computational requirements during inference without the need to retrain the model. Additionally, owing to the resolution-invariant evaluation capability of continuous representations, we show that continuous representations enable efficient inference across varying resolutions. In the context of learning on irregular domains, we introduce a technique for operator learning on arbitrary geometries. As machine learning advances, continuous representations provide a powerful and flexible framework that addresses fundamental open questions in the field and promises to redefine current boundaries.","abstract_has_math":false,"creators":["Runkel, Christina"],"institution":"University of Cambridge","degree_name":"Doctor of Philosophy (PhD)","degree_level":"Doctoral","degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":["Schoenlieb, Carola-Bibiane"],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-09-30","date_published":"2025-09-30","updated_at":"2026-07-22T22:24:20Z","subjects":["Continuous Representations","Deep Learning","Inverse Problems","Machine Learning","Medical Imaging","Neural Networks","Neural Operator","Partial Differential Equations"],"languages":["eng"],"rights":[],"rights_urls":["https://www.repository.cam.ac.uk/bitstreams/4ddca406-0bd2-42a0-81a1-ff3f38438fc3/download","http://purl.org/NET/rdflicense/allrightsreserved"],"identifier_entries":[{"key":"dc:creator.authoridentifier","label":"Author Identifier","values":["0009000169809022"],"render_values":[{"text":"0009-0001-6980-9022","href":"https://orcid.org/0009-0001-6980-9022","code":true}]}]},"links":{"outbound_url":"https://doi.org/10.17863/CAM.127146","outbound_label":"DOI","outbound_source":"dc:identifier.doi"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Schoenlieb, Carola-Bibiane"]},{"key":"dc:contributor.sponsor","label":"Sponsor","values":["EPSRC (EP/W524141/1) Cantab Capital Institute for the Mathematics of Information"]},{"key":"dc:creator","label":"Author","values":["Runkel, Christina"]},{"key":"dc:creator.authoridentifier","label":"Author Identifier","values":["0009000169809022"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.issued","label":"Date","values":["2025-09-30"]},{"key":"dc:publisher.institution","label":"Dc Publisher Institution","values":["University of Cambridge"]},{"key":"dc:relation.isreferencedby.uri","label":"Dc Relation Isreferencedby URI","values":["https://www.repository.cam.ac.uk/handle/1810/398241"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"dc:type.qualificationlevel","label":"Dc Type Qualificationlevel","values":["Doctoral"]},{"key":"dc:type.qualificationname","label":"Dc Type Qualificationname","values":["Doctor of Philosophy (PhD)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Continuous Representations","Deep Learning","Inverse Problems","Machine Learning","Medical Imaging","Neural Networks","Neural Operator","Partial Differential Equations"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["https://www.repository.cam.ac.uk/bitstreams/4ddca406-0bd2-42a0-81a1-ff3f38438fc3/download","http://purl.org/NET/rdflicense/allrightsreserved"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.17863/CAM.127146"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://www.repository.cam.ac.uk/bitstreams/f18fcb88-51f2-4682-afcc-f9d1445f0e9f/download"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Machine learning has led to significant advancements in many areas of our everyday lives, in addition to various fields in science. Machine and particularly deep learning methods have been used for applications such as protein structure prediction, drug discovery, climate modelling and medical imaging. Despite their successes, fundamental challenges remain regarding their theoretical understanding and interpretability, generalisation capabilities particularly in low data regimes, robustness to noise and training in restricted resource settings. Many real-world observations can naturally be described as continuous processes rather than discrete data points -- making their data inherently continuous. Consequently, in recent years, the deep learning research community has increasingly explored continuous representations, which refer to both continuous representations of data and neural networks. They enable resolution independent evaluation, as well as physics-informed and geometry-aware learning. In this thesis, the implications of continuous representations on open questions in machine learning research are investigated. We explore theoretical understanding, generalisation capabilities, robustness to noise, training in restricted resource settings and learning on arbitrary geometries. We show that continuous representations enable theoretical insights and improve interpretability by leveraging findings from well-established fields like ordinary differential equation theory. Through numerical experiments in the field of operator learning, we demonstrate that continuous representations improve generalisation, particularly in low data regimes, and provide theoretical and numerical insights into adaptive sampling strategies for continuous representations of neural networks. Furthermore, we demonstrate their robustness against noise, making them particularly well-suited for medical imaging, a field often challenged by significant noise levels. While neural networks are becoming increasingly more expressive and their number of parameters increases, their training and inference also becomes more and more challenging due to greater computational and memory costs. Thus, we propose a method to reduce memory and computational requirements during inference without the need to retrain the model. Additionally, owing to the resolution-invariant evaluation capability of continuous representations, we show that continuous representations enable efficient inference across varying resolutions. In the context of learning on irregular domains, we introduce a technique for operator learning on arbitrary geometries. As machine learning advances, continuous representations provide a powerful and flexible framework that addresses fundamental open questions in the field and promises to redefine current boundaries."]},{"key":"dc:format.checksum.md5","label":"Dc Format Checksum Md5","values":["fee4ab49077dd1af3362f28ecdd41298","87eda9de84448d1f82354d60eee3eb5f"]},{"key":"dc:title","label":"Title","values":["Continuous Representations in Machine Learning - With applications to medical imaging and operator learning"]}]}],"canonical_facts":{"dc:contributor.advisor":["Schoenlieb, Carola-Bibiane"],"dc:contributor.sponsor":["EPSRC (EP/W524141/1) Cantab Capital Institute for the Mathematics of Information"],"dc:creator":["Runkel, Christina"],"dc:creator.authoridentifier":["0009000169809022"],"dc:date.issued":["2025-09-30"],"dc:description.abstract":["Machine learning has led to significant advancements in many areas of our everyday lives, in addition to various fields in science. Machine and particularly deep learning methods have been used for applications such as protein structure prediction, drug discovery, climate modelling and medical imaging. Despite their successes, fundamental challenges remain regarding their theoretical understanding and interpretability, generalisation capabilities particularly in low data regimes, robustness to noise and training in restricted resource settings. Many real-world observations can naturally be described as continuous processes rather than discrete data points -- making their data inherently continuous. Consequently, in recent years, the deep learning research community has increasingly explored continuous representations, which refer to both continuous representations of data and neural networks. They enable resolution independent evaluation, as well as physics-informed and geometry-aware learning. In this thesis, the implications of continuous representations on open questions in machine learning research are investigated. We explore theoretical understanding, generalisation capabilities, robustness to noise, training in restricted resource settings and learning on arbitrary geometries. We show that continuous representations enable theoretical insights and improve interpretability by leveraging findings from well-established fields like ordinary differential equation theory. Through numerical experiments in the field of operator learning, we demonstrate that continuous representations improve generalisation, particularly in low data regimes, and provide theoretical and numerical insights into adaptive sampling strategies for continuous representations of neural networks. Furthermore, we demonstrate their robustness against noise, making them particularly well-suited for medical imaging, a field often challenged by significant noise levels. While neural networks are becoming increasingly more expressive and their number of parameters increases, their training and inference also becomes more and more challenging due to greater computational and memory costs. Thus, we propose a method to reduce memory and computational requirements during inference without the need to retrain the model. Additionally, owing to the resolution-invariant evaluation capability of continuous representations, we show that continuous representations enable efficient inference across varying resolutions. In the context of learning on irregular domains, we introduce a technique for operator learning on arbitrary geometries. As machine learning advances, continuous representations provide a powerful and flexible framework that addresses fundamental open questions in the field and promises to redefine current boundaries."],"dc:format.checksum.md5":["fee4ab49077dd1af3362f28ecdd41298","87eda9de84448d1f82354d60eee3eb5f"],"dc:identifier.doi":["https://doi.org/10.17863/CAM.127146"],"dc:identifier.uri":["https://www.repository.cam.ac.uk/bitstreams/f18fcb88-51f2-4682-afcc-f9d1445f0e9f/download"],"dc:language":["eng"],"dc:publisher.institution":["University of Cambridge"],"dc:relation.isreferencedby.uri":["https://www.repository.cam.ac.uk/handle/1810/398241"],"dc:rights":["https://www.repository.cam.ac.uk/bitstreams/4ddca406-0bd2-42a0-81a1-ff3f38438fc3/download","http://purl.org/NET/rdflicense/allrightsreserved"],"dc:subject":["Continuous Representations","Deep Learning","Inverse Problems","Machine Learning","Medical Imaging","Neural Networks","Neural Operator","Partial Differential Equations"],"dc:title":["Continuous Representations in Machine Learning - With applications to medical imaging and operator learning"],"dc:type":["Thesis"],"dc:type.qualificationlevel":["Doctoral"],"dc:type.qualificationname":["Doctor of Philosophy (PhD)"]},"updated_at":"2026-07-22T22:24:20Z"}