Robust Machine Learning Against Faults in Micro-Controllers and Stragglers in Distributed Training on the Cloud

Machine learning has become a critical part of many industries in the past decade. Optimally deploying ML models onto smaller devices and efficiently training more powerful ML models in parallel in different distributed system topologies have drawn interests. This thesis studies the robustness of ML models in the two scenarios when deployed on portable micro-controller units and while being trained on distributed GPUs. This thesis first investigates the robustness of ML inference in micro-controllers. The vulnerabilities of Tiny ML models on micro-controllers are showcased using voltage based fault injection attacks. This thesis provides a comprehensive guide to quantization of ML models for embedded system deployment. Experimental results from this thesis show that it is possible to force misclassifications of model inference outputs. It also suggests defenses for protecting such physical vulnerabilities of a micro-controller running Tiny ML models. This thesis then considers the faults in distributed training of ML models on the cloud and discusses the affects and risks of stragglers. It then applies two linear coding algorithms; Gradient and Compression coding to make distributed ML training fault tolerant. This thesis shows that linear coding algorithms can be applied to GPUs. The experiments in this thesis show that using fault tolerant linear coding on GPUs does create fault tolerance to a certain number of stragglers at the cost of more training time. It finally discusses the possibility of applying linear coding algorithms to more complicated distributed training paradigms.

Name thesis:degree_name

Master of Science

Level thesis:degree_level

masters

Discipline thesis:degree_discipline

Computer Engineering

Department dc:contributor.department

Electrical and Computer Engineering

Grantor dc:publisher

Virginia Tech

Year dc:date.issued

2025

Author dc:creator

• Nampally, Srilalith

Chairs dc:contributor.committeechair

• Xiong, Wenjie
• Matthews, Gretchen L.

Committee member dc:contributor.committeemember

• Jin, Ming

• Robust ML
• Tiny ML
• Distributed Training
• Coding Theory

Statement dc:rights

• In Copyright

Licence dc:rights.uri

• http://rightsstatements.org/vocab/InC/1.0/

Language dc:language.iso

en

Dc Identifier Other

vt_gsexam:44092

OAI identifier oai:identifier

oai:vtechworks.lib.vt.edu:10919/134212