Maximal Correlation Feature Selection and Suppression With Applications

In standard supervised learning, we assume that we are trying to learn some target variable 𝑌 from some data 𝑋. However, many learning problems can be framed as supervised learning with an auxiliary objective, often associated with an auxiliary variable 𝐷 which defines this objective. Applying the principles of Hirschfeld-Gebelein-Rényi (HGR) maximal correlation analysis reveals new insights as to how to formulate these learning problems with auxiliary objectives. We examine the use of the HGR in feature selection for multi-source transfer learning learning in the fewshot setting. We then apply HGR to the problem of feature suppression via enforcing marginal and conditional independence criteria with respect to a sensitive attribute, and illustrate the effectiveness of our methods to problems of fairness, privacy, and transfer learning. Finally, we explore the use of HGR in extracting features for outlier detection.

Name thesis:degree_name

Doctoral

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2021

Author dc:creator

• Lee, Joshua Ka-Wing

Advisor dc:contributor.advisor

• Wornell, Gregory W.

Statement dc:rights

• In Copyright - Educational Use Permitted
• Copyright MIT

Licence dc:rights.uri

• http://rightsstatements.org/page/InC-EDU/1.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/140035

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/140035