Reinforcement learning and optimization methods in sensor networks

Distributed Sensor Networks (DSNs) [1] are ubiquitous in civilian and military applications, with a wide range of uses including motion detection, healthcare, remote sensing, surveillance, and imaging. The deployment of DSNs involves various constraints on the sensor nodes and the network, such as i) bandwidth-limited communication ii) power consumption iii) response time of sensor nodes iv) compute limitations and many others. For instance, a DSN deployed in a battlefield must exhibit low power consumption and fast sensor response time to external stimuli within a bandwidth-limited communication network. In recent years, computing power has undergone significant advancements, largely propelled by improvements in System-on-Chip (SoC) technologies. These improvements have paved the way for the integration of Machine Learning (ML) capabilities into sensor nodes. Machine learning algorithms often leverage neural networks, which demand substantial memory, bandwidth, and computational resources. Consequently, this imposes heightened bandwidth and power requisites on DSNs to support ML implementation in sensor nodes. Thus, there arises a pressing need for innovative algorithms aimed at resource optimization within DSNs, a challenge that we address in this thesis. Resource optimization algorithms for DSNs vary based on their topology. In this thesis, we focus on DSNs characterized by a centralized structure, comprising a central controller/central node and numerous sensor nodes. Notably, the sensors can communicate only with the central node. Within the scope of this thesis, we refer to this topology as the central topology. Within central topology DSNs, we tackle two distinct problems; i) energy efficient model-free approach to tracking an object moving through a sensing grid ii) bandwidth-efficient methods for learning a machine learning model at the central controller using data gathered from the sensor nodes. We address the problem of energy efficient model-free tracking though the lens of RL (Reinforcement Learning) and the problem of bandwidth efficient learning through compressed distributed Stochastic Gradient Descent (SGD).

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Electrical & Computer Engr

Grantor

University of Illinois Urbana-Champaign

Year dc:date

2025

Author dc:creator

• Muthuveeru-Subramaniam, Adarsh

Contributors dc:contributor

• Veeravalli, Venugopal V.
• Veeravalli, Venugopal V
• Moulin, Pierre
• Varshney, Lav R
• Chatterjee, Sabyasachi
• Zachary Hare, James

• Reinforcement Learning
• Optimization
• Sensor Networks

Statement dc:rights

• Copyright 2025 Adarsh Muthuveeru-Subramaniam

Language dc:language

en, eng

Handle dc:identifier

https://hdl.handle.net/2142/129955

OAI record oai:identifier

https://www.ideals.illinois.edu/oai-pmh?verb=GetRecord&metadataPrefix=etdms&identifier=oai%3Awww.ideals.illinois.edu%3A2142%2F129955