{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/124231"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/124231","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Distribution-free uncertainty quantification for deep learning","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","abstract_has_math":false,"creators":["Lin, Zhen"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Sun, Jimeng","Rehg, James M","Tong, Hanghang","Romano, Yaniv"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-05","date_published":"2024-05","updated_at":"2026-07-22T22:25:00Z","subjects":["Uncertainty Quantification","Deep Learning","Machine Learning","Conformal Prediction","Prediction Set","Neural Networks","Cross-sectional Time-series","Healthcare Applications"],"languages":["en","eng"],"rights":["Copyright 2024 Zhen Lin"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/124231","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Sun, Jimeng","Rehg, James M","Tong, Hanghang","Romano, Yaniv"]},{"key":"dc:creator","label":"Author","values":["Lin, Zhen"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-05","2024-04-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Uncertainty Quantification","Deep Learning","Machine Learning","Conformal Prediction","Prediction Set","Neural Networks","Cross-sectional Time-series","Healthcare Applications"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Zhen Lin"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/124231"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","The student, Zhen Lin, accepted the attached license on 2024-04-04 at 22:02.","The student, Zhen Lin, submitted this Dissertation for approval on 2024-04-04 at 22:09.","This Dissertation was approved for publication on 2024-04-08 at 10:35.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20303 on 2024-09-16 at 00:33:41","The integration of sophisticated deep learning models into critical domains, such as healthcare, autonomous vehicles, and the legal system, is increasingly becoming a trend. These models offer significant potential for enhancing outcomes efficiently, but their adoption raises crucial challenges related to model confidence, uncertainty communication, and risk management. Uncertainty Quantification (UQ) is a key framework that addresses these issues by providing a systematic way to assess and act on the reliability of model predictions. This thesis focuses on distribution-free UQ methods, which require minimal assumptions about the data distribution and model specifics, making them highly applicable across various deep learning applications. We first investigate the problem of full calibration for deep learning classifiers, aiming to address the over-confidence or under-confidence typically observed in such classifiers. Then, we discuss methods to convert a model's output into actionable uncertainty information, expressed as prediction intervals and prediction sets. In particular, we focus on the construction of prediction intervals and sets with rigorous coverage or risk control guarantees, typically provided by conformal prediction tools. Finally, we explore the problem of UQ for natural language generation (NLG), for which we apply a graph-based approach using the similarity graph of multiple sampled responses. Through exploring model calibration, risk-controlling prediction sets, conformal prediction intervals, and UQ for NLG, this thesis aims to advance the understanding and implementation of UQ in high-stakes decision-making environments."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Distribution-free uncertainty quantification for deep learning"]}]}],"canonical_facts":{"dc:contributor":["Sun, Jimeng","Rehg, James M","Tong, Hanghang","Romano, Yaniv"],"dc:creator":["Lin, Zhen"],"dc:date":["2024-05","2024-04-08"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2024-09-16 without embargo terms","The student, Zhen Lin, accepted the attached license on 2024-04-04 at 22:02.","The student, Zhen Lin, submitted this Dissertation for approval on 2024-04-04 at 22:09.","This Dissertation was approved for publication on 2024-04-08 at 10:35.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20303 on 2024-09-16 at 00:33:41","The integration of sophisticated deep learning models into critical domains, such as healthcare, autonomous vehicles, and the legal system, is increasingly becoming a trend. These models offer significant potential for enhancing outcomes efficiently, but their adoption raises crucial challenges related to model confidence, uncertainty communication, and risk management. Uncertainty Quantification (UQ) is a key framework that addresses these issues by providing a systematic way to assess and act on the reliability of model predictions. This thesis focuses on distribution-free UQ methods, which require minimal assumptions about the data distribution and model specifics, making them highly applicable across various deep learning applications. We first investigate the problem of full calibration for deep learning classifiers, aiming to address the over-confidence or under-confidence typically observed in such classifiers. Then, we discuss methods to convert a model's output into actionable uncertainty information, expressed as prediction intervals and prediction sets. In particular, we focus on the construction of prediction intervals and sets with rigorous coverage or risk control guarantees, typically provided by conformal prediction tools. Finally, we explore the problem of UQ for natural language generation (NLG), for which we apply a graph-based approach using the similarity graph of multiple sampled responses. Through exploring model calibration, risk-controlling prediction sets, conformal prediction intervals, and UQ for NLG, this thesis aims to advance the understanding and implementation of UQ in high-stakes decision-making environments."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/124231"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Zhen Lin"],"dc:subject":["Uncertainty Quantification","Deep Learning","Machine Learning","Conformal Prediction","Prediction Set","Neural Networks","Cross-sectional Time-series","Healthcare Applications"],"dc:title":["Distribution-free uncertainty quantification for deep learning"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:00Z"}