{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/130072"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/130072","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Improve and certify ML robustness by integrating exogenous information","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","abstract_has_math":false,"creators":["Yang, Zhuolin"],"institution":"University of Illinois Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Gunter, Carl","Li, Bo","Wang, Gang","Zhang, Huan","Xu, Kaidi"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-05-29","date_published":"2025-05-29","updated_at":"2026-07-22T22:25:06Z","subjects":["Adversarial Attacks","Ml Robustness","Nn Verification"],"languages":["en","eng"],"rights":["Copyright 2025 Zhuolin Yang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/130072","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Gunter, Carl","Li, Bo","Wang, Gang","Zhang, Huan","Xu, Kaidi"]},{"key":"dc:creator","label":"Author","values":["Yang, Zhuolin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-05-29","2025-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Adversarial Attacks","Ml Robustness","Nn Verification"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Zhuolin Yang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/130072"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","The student, Zhuolin Yang, accepted the attached license on 2025-05-08 at 14:17.","The student, Zhuolin Yang, submitted this Dissertation for approval on 2025-05-08 at 14:26.","This Dissertation was approved for publication on 2025-05-29 at 09:49.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22189 on 2025-10-25 at 15:30:41","Several studies have shown that deep neural networks (DNNs) are vulnerable to adversarial examples, which are constructed by adding a carefully crafted noise with small magnitude onto natural inputs thus misleading DNNs. A lot of work has addressed the importance of improving the robustness of DNNs and various robustness enhancing methods have been proposed. However, most of recent works focused on improving robustness of model itself, without exploring exogenous information that are critical for model to make the correct prediction under adversarial scenarios. This thesis presents novel methodologies to improve and certify ML robustness by integrating exogenous information and leveraging various theoretical and empirical techniques on several sub-topics. To import external domain knowledge into model inference, we propose sensing-reasoning pipeline to integrate statistical learning with logical reasoning to cooperate such domain knowledge rules and develop the end-to-end certification algorithm on top of that. We also delve into analyzing the cause of adversarial transferability theoretically under teacher-student setting, providing the sufficient condition of the adversarial example’s existence in student model due to low dimensionality and neuron specialization. On the general cases, among pair of ML models, we first theoretically derive the sufficient and necessary condition on adversarial transferability - gradient similarity and model smoothness, and practically develop Transferability Reduced Smooth (TRS) regularized training algorithm on top of ensemble ML models to improve their robustness. Additionally, on certifiable robustness domain, for ensemble model, we first formally defined the robustness of ensemble w.r.t different ensemble protocol, and analyze the key factors within smoothed ensemble verifiable radius. Beyond that we propose Diversity Regularized Training (DRT) method to improve certified robustness of ensemble ML models by encouraging gradient diversity and enlarging the confidence margin. For single model certifiable robustness, we also explore the internal factors – neuron implications, to accelerate ML verification by reducing redundant branches and improving intermediate bounds in Branch-and-Bound (BaB) procedure. We believe these research works could provide key insights on exploring ML robustness from various perspective – How to gather and integrate exogenous information within models and corresponding tasks could be an interesting direction for later adversarial ML research."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Improve and certify ML robustness by integrating exogenous information"]}]}],"canonical_facts":{"dc:contributor":["Gunter, Carl","Li, Bo","Wang, Gang","Zhang, Huan","Xu, Kaidi"],"dc:creator":["Yang, Zhuolin"],"dc:date":["2025-05-29","2025-08"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","The student, Zhuolin Yang, accepted the attached license on 2025-05-08 at 14:17.","The student, Zhuolin Yang, submitted this Dissertation for approval on 2025-05-08 at 14:26.","This Dissertation was approved for publication on 2025-05-29 at 09:49.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22189 on 2025-10-25 at 15:30:41","Several studies have shown that deep neural networks (DNNs) are vulnerable to adversarial examples, which are constructed by adding a carefully crafted noise with small magnitude onto natural inputs thus misleading DNNs. A lot of work has addressed the importance of improving the robustness of DNNs and various robustness enhancing methods have been proposed. However, most of recent works focused on improving robustness of model itself, without exploring exogenous information that are critical for model to make the correct prediction under adversarial scenarios. This thesis presents novel methodologies to improve and certify ML robustness by integrating exogenous information and leveraging various theoretical and empirical techniques on several sub-topics. To import external domain knowledge into model inference, we propose sensing-reasoning pipeline to integrate statistical learning with logical reasoning to cooperate such domain knowledge rules and develop the end-to-end certification algorithm on top of that. We also delve into analyzing the cause of adversarial transferability theoretically under teacher-student setting, providing the sufficient condition of the adversarial example’s existence in student model due to low dimensionality and neuron specialization. On the general cases, among pair of ML models, we first theoretically derive the sufficient and necessary condition on adversarial transferability - gradient similarity and model smoothness, and practically develop Transferability Reduced Smooth (TRS) regularized training algorithm on top of ensemble ML models to improve their robustness. Additionally, on certifiable robustness domain, for ensemble model, we first formally defined the robustness of ensemble w.r.t different ensemble protocol, and analyze the key factors within smoothed ensemble verifiable radius. Beyond that we propose Diversity Regularized Training (DRT) method to improve certified robustness of ensemble ML models by encouraging gradient diversity and enlarging the confidence margin. For single model certifiable robustness, we also explore the internal factors – neuron implications, to accelerate ML verification by reducing redundant branches and improving intermediate bounds in Branch-and-Bound (BaB) procedure. We believe these research works could provide key insights on exploring ML robustness from various perspective – How to gather and integrate exogenous information within models and corresponding tasks could be an interesting direction for later adversarial ML research."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/130072"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Zhuolin Yang"],"dc:subject":["Adversarial Attacks","Ml Robustness","Nn Verification"],"dc:title":["Improve and certify ML robustness by integrating exogenous information"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:06Z"}