Computational Privacy with Split Learning: Benchmarking of Algorithmic Defenses against Reconstruction Attacks

Distributed deep learning has potential for significant impact in preserving data privacy and improving model accuracy by leveraging massive sets of training data. However, passing intermediate weights, gradients, or activations is inherent in current distributed learning techniques, all of which contain information related to input data. This thesis analyzes split learning, a current state of the art distributed deep learning technique, in the context of the private collaborative inference scheme against reconstruction attacks. This is achieved by creating a benchmark and introducing new methods of improving privacy algorithmically. Benchmarking is done by comparing input data reconstruction quality and accuracy of sensitive attribute prediction over the axes of number of activation, input data pairs are leaked, and whether or not model parameters and general data distribution information is known. The proposed privacy improvements involve changes in model training to leak less information that may be used for reconstruction while preserving accuracies for the originally intended model prediction task. These improvements are compared against current state of the art privacy methods in protection over various reconstruction attacks.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2021

Author dc:creator

• Zhang, Emily T.

Advisor dc:contributor.advisor

• Raskar, Ramesh

Statement dc:rights

• In Copyright - Educational Use Permitted
• Copyright MIT

Licence dc:rights.uri

• http://rightsstatements.org/page/InC-EDU/1.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/139497

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/139497