Distributionally robust binary classifier under Wasserstein distance

The robustification of statistical models has been a popular topic for decades. Statistical robustification and robust optimization are the two main approaches in the literature, where the former stabilizes the model output by removing the outlier points while the latter concerns more the outlier points in making the conservative decisions. This thesis develops a novel robust optimization perspective to robustify a class of binary classifiers. Our model considers the worst-case distribution within a pre-determined uncertainty ball that centers at the given benchmark distribution with the radius calculated as per the Wasserstein distance. We derive the tractable formulation for the general problem. When focusing on the support vector machine (SVM), the general problem boils down to an easy-to-solve second- order cone programming problem. The robustified SVM is then applied to synthetic data with and without contamination, and our simulation studies show that our robustified SVM model can outperform the classical SVM and the extreme empirical loss SVM models under many circumstances.

Name thesis:degree_name

Master of Science (MSc)

Discipline thesis:degree_discipline

Mathematics & Statistics

Grantor dc:publisher.institution

Graduate Studies

Year dc:date.issued

2024

Author dc:creator

• Huang, Qian

Advisors dc:contributor.advisor

• Wu, Jingjing
• Zhang, Qingrun

Committee members dc:contributor.committeemember

• Liao, Wenyuan
• Swishchuk, Anatoliy

• Distributional robustness
• Binary classifier
• Support vector machine
• Wasserstein distance

Statement dc:rights

• University of Calgary graduate students retain copyright ownership and moral rights for their thesis. You may use this material in any way that is permitted by the Copyright Act or through licensing that has been assigned to the document. For uses that are not allowable under copyright legislation or licensing, you are required to seek permission.

Language dc:language.iso

en

DOI

https://dx.doi.org/10.11575/PRISM/47282

OAI identifier oai:identifier

oai:ucalgary.scholaris.ca:1880/119671