Stochastic Algorithms in Riemannian Manifolds and Adaptive Networks
type: CreativeWork
description: The combination of adaptive network algorithms and stochastic geometric dynamics has the potential to make a large impact in distributed control and signal processing applications. However, both literatures contain fundamental unsolved problems. The thesis is thus in two main parts. In part I, we consider stochastic differential equations (SDEs) evolving in a matrix Lie group. To undertake any kind of statistical signal processing or control task in this setting requires the simulation of such geometric SDEs. This foundational issue has barely been addressed previously. Chapter 1 contains background and motivation. Chapter 2 develops numerical schemes for simulating SDEs that evolve in SO(n) and SE(n). We propose novel, reliable, efficient schemes based on diagonal Padé approximants, where each trajectory lies in the respective manifold. We prove first order convergence in mean uniform squared error using a new proof technique. Simulations for SDEs in SO(50) are provided. In part II, we study adaptive networks. These are collections of individual agents (nodes) that cooperate to solve estimation, detection, learning and adaptation problems in real time from streaming data, without a fusion center. We study general diffusion LMS algorithms - including real time consensus - for distributed MMSE parameter estimation. This choice is motivated by two major flaws in the literature. First, all analyses assume the regressors are white noise, whereas in practice serial correlation is pervasive. Dealing with it however is much harder than the white noise case. Secondly, since the algorithms operate in real time, we must consider realization-wise behavior. There are no such results. To remedy these flaws, we uncover the mixed time scale structure of the algorithms. We then perform a novel mixed time scale stochastic averaging analysis. Chapter 3 contains background and motivation. Realization-wise stability (chapter 4) and performance including network MSD, EMSE and realizatio…
abstract: The combination of adaptive network algorithms and stochastic geometric dynamics has the potential to make a large impact in distributed control and signal processing applications. However, both literatures contain fundamental unsolved problems. The thesis is thus in two main parts. In part I, we consider stochastic differential equations (SDEs) evolving in a matrix Lie group. To undertake any kind of statistical signal processing or control task in this setting requires the simulation of such geometric SDEs. This foundational issue has barely been addressed previously. Chapter 1 contains background and motivation. Chapter 2 develops numerical schemes for simulating SDEs that evolve in SO(n) and SE(n). We propose novel, reliable, efficient schemes based on diagonal Padé approximants, where each trajectory lies in the respective manifold. We prove first order convergence in mean uniform squared error using a new proof technique. Simulations for SDEs in SO(50) are provided. In part II, we study adaptive networks. These are collections of individual agents (nodes) that cooperate to solve estimation, detection, learning and adaptation problems in real time from streaming data, without a fusion center. We study general diffusion LMS algorithms - including real time consensus - for distributed MMSE parameter estimation. This choice is motivated by two major flaws in the literature. First, all analyses assume the regressors are white noise, whereas in practice serial correlation is pervasive. Dealing with it however is much harder than the white noise case. Secondly, since the algorithms operate in real time, we must consider realization-wise behavior. There are no such results. To remedy these flaws, we uncover the mixed time scale structure of the algorithms. We then perform a novel mixed time scale stochastic averaging analysis. Chapter 3 contains background and motivation. Realization-wise stability (chapter 4) and performance including network MSD, EMSE and realizatio…
author: Piggott, Marc
language: EN
keywords: convergence, strong mixing, correlation, distributed learning, stochastic averaging, Lie groups, LMS
license: https://purl.org/coar/access_right/c_abf2
license: https://creativecommons.org/licenses/by-nc-nd/3.0/au/
date published: 2016
date modified: 2026-07-24T05:33:55Z
provider: University of New South Wales
publisher: Networked Digital Library of Theses and Dissertations
type: WebPage
source organization: UNSW, Sydney

PropertyValue
property ID: Handle
value: http://hdl.handle.net/1959.4/57040

PropertyValue
property ID: DOI
value: 10.26190/unsworks/19289