Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environment
type: CreativeWork
description: This thesis brings together ideas from causality and representation learning. Causal models provide rich descriptions of complex systems as sets of mechanisms by which each variable is influenced by its direct causes. They support reasoning about manipulating parts of the system, capture a whole range of interventional distributions, and thus hold promise for addressing some of the open challenges of artificial intelligence (AI), such as planning, transferring knowledge in changing environments, or robustness to distribution shifts. However, a key obstacle to a more widespread use of causal models in AI is the requirement that the relevant variables need to be specified a priori, which is typically not the case for the high-dimensional, unstructured data processed by modern AI systems. At the same time, machine learning (ML) has proven quite successful at automatically extracting useful and compact representations of such complex data. Causal representation learning (CRL) aims to combine the core strengths of ML and causality by learning representations in the form of latent variables endowed with causal model semantics. In this thesis, we study and present new results for different CRL settings. A central theme is the question of identifiability: Given infinite data, when are representations satisfying the same learning objective guaranteed to be equivalent? This is arguably an important prerequisite for CRL, as it formally characterises if and when a learning task is, at least in principle, feasible. Since learning causal models—even without a representation learning component—is notoriously difficult, we require additional assumptions on the model class or rich data beyond the classical i.i.d. setting. For unsupervised representation learning from i.i.d. data, we develop independent mechanism analysis, a constraint on the mixing function mapping latent to observed variables, which is shown to promote the identifiability of independent latents. For a multi-view se…
abstract: This thesis brings together ideas from causality and representation learning. Causal models provide rich descriptions of complex systems as sets of mechanisms by which each variable is influenced by its direct causes. They support reasoning about manipulating parts of the system, capture a whole range of interventional distributions, and thus hold promise for addressing some of the open challenges of artificial intelligence (AI), such as planning, transferring knowledge in changing environments, or robustness to distribution shifts. However, a key obstacle to a more widespread use of causal models in AI is the requirement that the relevant variables need to be specified a priori, which is typically not the case for the high-dimensional, unstructured data processed by modern AI systems. At the same time, machine learning (ML) has proven quite successful at automatically extracting useful and compact representations of such complex data. Causal representation learning (CRL) aims to combine the core strengths of ML and causality by learning representations in the form of latent variables endowed with causal model semantics. In this thesis, we study and present new results for different CRL settings. A central theme is the question of identifiability: Given infinite data, when are representations satisfying the same learning objective guaranteed to be equivalent? This is arguably an important prerequisite for CRL, as it formally characterises if and when a learning task is, at least in principle, feasible. Since learning causal models—even without a representation learning component—is notoriously difficult, we require additional assumptions on the model class or rich data beyond the classical i.i.d. setting. For unsupervised representation learning from i.i.d. data, we develop independent mechanism analysis, a constraint on the mixing function mapping latent to observed variables, which is shown to promote the identifiability of independent latents. For a multi-view se…
author: von Kügelgen, Julius
language: eng
keywords: AI, artificial intelligence, causal inference, causal representation learning, causality, identfifiability, latent variable model, machine learning, representation learning, unsupervised learning
license: https://apollo8-f-pro.lib.cam.ac.uk/bitstreams/6bf6e327-d65a-4a6d-b8b9-99ccebc62e3b/download
license: https://creativecommons.org/licenses/by-nc-sa/4.0/
date published: 2023-11-27
date modified: 2026-07-22T22:24:03Z
provider: Cambridge University
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: University of Cambridge

PropertyValue
property ID: DOI
value: 10.17863/CAM.106852