Distributed Deep Learning in IoT: Splitting Neural Networks in Inference and Training

In this thesis, we first propose a scheme to solve the inference problem of Network of Neural Networks (NoNN) under changing channel conditions. The proposed scheme is composed of two methods: two devices work in parallel and one device works with the server. Error Correction Codes (ECC) are also applied to deal with the errors during data transmitting. Our scheme is to find the optimal method and code rate of ECC to maximize the accuracy within a specific delay threshold. Experiment results show that the proposed scheme performs much better than the other schemes for inference of NoNN under changing channel environment compared with other schemes with a single method or fixed code rate. We then propose a scheme applying Online Knowledge Distillation via Collaboratively Learning (KDCL) to Split Learning to get a distilled model of server-part model in SplitNN after training. The distilled model could be designed to fit the memory-limited Internet of Things (IoT) devices so that clients could get prediction results independently after receiving the distilled model from the server. In this way, high communication latency and costs between client and server can be avoided. Experiments show that the proposed scheme could successfully get a distilled model after training. Besides, the accuracies of both the original model and distilled model could get a significant improvement compared with baseline models.

Department dc:contributor.department

Electrical and Computer Engineering

Author dc:creator

• Guo, Jia

Advisor dc:contributor.supervisor

• Kim, Il-Min

• distributed deep learning
• IoT
• Split Learning

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1974/30060

OAI identifier oai:identifier

oai:queensu.scholaris.ca:1974/30060