Fair, Robust, and Calibrated Deep Learning with Heavy-Tailed Subgroups

To deploy safe machine learning systems in the real world, we must ensure they are fair, robust, and calibrated. However, heavy-tails pose a challenge to this mandate, especially since real world data is often imbalanced and marginalized subgroups tend to be underrepresented. To move toward safer systems, we present two studies on fair pre-processing and ensemble learning, respectively. We show that fair pre-processing comes with a fairness-robustness-calibration tradeoff, and we present a novel adaptive sampling algorithm to overcome this tradeoff. Furthermore, we demonstrate that ensemble learning on its own increases the fairness, robustness, and calibration of machine learning models. The adaptive sampling algorithm and ensemble learning present opportunities for practitioners to overcome this tradeoff in practice.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2023

Author dc:creator

• Hampton, Lelia Marie

Advisor dc:contributor.advisor

• Pentland, Alexander P.

Statement dc:rights

• In Copyright - Educational Use Permitted
• Copyright retained by author(s)

Licence dc:rights.uri

• https://rightsstatements.org/page/InC-EDU/1.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/151670

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/151670