{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/122023"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/122023","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Machine learning for security applications under dynamic and adversarial environments","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-03-01 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-03-01 without embargo terms","abstract_has_math":false,"creators":["Yang, Limin"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Wang, Gang","Gunter, Carl A.","Iyer, Ravishankar K.","Kalbarczyk, Zbigniew T.","Cavallaro, Lorenzo"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-12","date_published":"2023-12","updated_at":"2026-07-22T22:25:00Z","subjects":["Machine Learning Security","Concept Drift","Malware Detection","Network Intrusion Detection"],"languages":["en","eng"],"rights":["Copyright 2023 Limin Yang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/122023","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Wang, Gang","Gunter, Carl A.","Iyer, Ravishankar K.","Kalbarczyk, Zbigniew T.","Cavallaro, Lorenzo"]},{"key":"dc:creator","label":"Author","values":["Yang, Limin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-12","2023-11-28"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Machine Learning Security","Concept Drift","Malware Detection","Network Intrusion Detection"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2023 Limin Yang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/122023"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-03-01 without embargo terms","The student, Limin Yang, accepted the attached license on 2023-11-27 at 17:37.","The student, Limin Yang, submitted this Dissertation for approval on 2023-11-27 at 17:58.","This Dissertation was approved for publication on 2023-11-28 at 15:25.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20028 on 2024-03-01 at 13:15:07","The security community, including both academia and industry, is increasingly adopting machine learning (ML) for its superior generalizability compared to traditional rule-based systems and its ability to automatically learn patterns that are difficult to explicitly describe. However, deploying and maintaining such learning-based models is challenging as they are susceptible to concept drift. This phenomenon arises when the security domain’s environments undergo dynamic changes over time, causing a misalignment between the testing and training data. Consequently, this mismatch often leads to significant failures of the deployed ML models. To combat concept drift, we focus on two popular security domains: malware detection and network intrusion detection systems (IDS). We first introduce CADE, a novel system to detect and explain concept drift in malware classifiers. CADE leverages contrastive learning- based autoencoder for drift detection, and a distance-based explanation for semantically meaningful reasoning. Additionally, concept drift and evolving attacks often require model updates, we leverage a sub-population distribution to develop a new selective backdoor attack (Jigsaw Puzzle) that compromises the model update process by protecting only a subset of malware samples from a specific family. This attack is stealthier than traditional universal backdoors and can evade existing defenses. Furthermore, we investigate the transition from supervised learning to unsupervised learn- ing in network IDS. This transition presents unique challenges due to the sparsity of attack data and the vast diversity of benign data. We analyze incident-level and alert-level dynamics as well as concept drift in a real-world network IDS. We provide insights into current research limitations in network IDS caused by the oversimplification of problem definitions that ignore excessive “attack attempts” and “benign triggers”. Moreover, we measure the concept drift by monitoring the anomaly detection performance in both a real-world dataset and a benchmark synthesized dataset. Our findings reveal that sparse and dispersed real-world attacks may significantly degrade the model performance compared to highly condensed attacks in existing benchmark datasets. In conclusion, this dissertation highlights the importance of understanding data distribution shifts in ML-based security applications. By enhancing detection and mitigation techniques, ML can better serve security tasks."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Machine learning for security applications under dynamic and adversarial environments"]}]}],"canonical_facts":{"dc:contributor":["Wang, Gang","Gunter, Carl A.","Iyer, Ravishankar K.","Kalbarczyk, Zbigniew T.","Cavallaro, Lorenzo"],"dc:creator":["Yang, Limin"],"dc:date":["2023-12","2023-11-28"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-03-01 without embargo terms","The student, Limin Yang, accepted the attached license on 2023-11-27 at 17:37.","The student, Limin Yang, submitted this Dissertation for approval on 2023-11-27 at 17:58.","This Dissertation was approved for publication on 2023-11-28 at 15:25.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20028 on 2024-03-01 at 13:15:07","The security community, including both academia and industry, is increasingly adopting machine learning (ML) for its superior generalizability compared to traditional rule-based systems and its ability to automatically learn patterns that are difficult to explicitly describe. However, deploying and maintaining such learning-based models is challenging as they are susceptible to concept drift. This phenomenon arises when the security domain’s environments undergo dynamic changes over time, causing a misalignment between the testing and training data. Consequently, this mismatch often leads to significant failures of the deployed ML models. To combat concept drift, we focus on two popular security domains: malware detection and network intrusion detection systems (IDS). We first introduce CADE, a novel system to detect and explain concept drift in malware classifiers. CADE leverages contrastive learning- based autoencoder for drift detection, and a distance-based explanation for semantically meaningful reasoning. Additionally, concept drift and evolving attacks often require model updates, we leverage a sub-population distribution to develop a new selective backdoor attack (Jigsaw Puzzle) that compromises the model update process by protecting only a subset of malware samples from a specific family. This attack is stealthier than traditional universal backdoors and can evade existing defenses. Furthermore, we investigate the transition from supervised learning to unsupervised learn- ing in network IDS. This transition presents unique challenges due to the sparsity of attack data and the vast diversity of benign data. We analyze incident-level and alert-level dynamics as well as concept drift in a real-world network IDS. We provide insights into current research limitations in network IDS caused by the oversimplification of problem definitions that ignore excessive “attack attempts” and “benign triggers”. Moreover, we measure the concept drift by monitoring the anomaly detection performance in both a real-world dataset and a benchmark synthesized dataset. Our findings reveal that sparse and dispersed real-world attacks may significantly degrade the model performance compared to highly condensed attacks in existing benchmark datasets. In conclusion, this dissertation highlights the importance of understanding data distribution shifts in ML-based security applications. By enhancing detection and mitigation techniques, ML can better serve security tasks."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/122023"],"dc:language":["en","eng"],"dc:rights":["Copyright 2023 Limin Yang"],"dc:subject":["Machine Learning Security","Concept Drift","Malware Detection","Network Intrusion Detection"],"dc:title":["Machine learning for security applications under dynamic and adversarial environments"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:00Z"}