{"id":{"repo_id":"toronto-retro","oai_identifier":"oai:utoronto.scholaris.ca:1807/145041"},"canonical_url":"https://search.dev.ndltd.org/etd/toronto-retro/oai:utoronto.scholaris.ca:1807/145041","repository":{"repo_id":"toronto-retro","name":"University of Toronto","base_url":"https://utoronto.scholaris.ca/server/oai/request"},"display":{"title":"Evaluation of Biases That Challenge the Implementation and Use of Machine Learning Clinical Decision Support Tools","abstract":"Clinical machine learning (ML) tools hold promise to improve patient care, though their effective implementation requires that several barriers be overcome. This thesis includes three projects designed to further understand these barriers and explore potential solutions. The first study investigated the presence and causes of sociodemographic bias in clinical ML algorithms. It found that algorithmic bias evaluations are infrequently performed, that algorithmic bias is often present, and that addressing algorithmic bias requires an approach tailored to the specific ML model and population. The second study evaluated for algorithmic bias across the development and implementation of a clinical ML tool that has been deployed into practice. This study is among the first such evaluations and identified an absence of algorithmic bias in model performance, clinical processes of care and patient outcomes for the CHARTwatch ML early warning system. This study also identified an opportunity for ML tools to be used to address pre-existing healthcare inequities, as well as outlining a roadmap for future ML implementation bias assessments. The third study evaluated how the clinical use of an ML algorithm can affect its performance over time through contamination bias. This study identified how key model parameters influence the magnitude of model performance change and explored methods to prevent model deterioration. These studies together provide strategies to identify and overcome key challenges in implementing clinical ML tools.","abstract_html":"Clinical machine learning (ML) tools hold promise to improve patient care, though their effective implementation requires that several barriers be overcome. This thesis includes three projects designed to further understand these barriers and explore potential solutions. The first study investigated the presence and causes of sociodemographic bias in clinical ML algorithms. It found that algorithmic bias evaluations are infrequently performed, that algorithmic bias is often present, and that addressing algorithmic bias requires an approach tailored to the specific ML model and population. The second study evaluated for algorithmic bias across the development and implementation of a clinical ML tool that has been deployed into practice. This study is among the first such evaluations and identified an absence of algorithmic bias in model performance, clinical processes of care and patient outcomes for the CHARTwatch ML early warning system. This study also identified an opportunity for ML tools to be used to address pre-existing healthcare inequities, as well as outlining a roadmap for future ML implementation bias assessments. The third study evaluated how the clinical use of an ML algorithm can affect its performance over time through contamination bias. This study identified how key model parameters influence the magnitude of model performance change and explored methods to prevent model deterioration. These studies together provide strategies to identify and overcome key challenges in implementing clinical ML tools.","abstract_has_math":false,"creators":["Colacci, Michael"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Dalla Lana School of Public Health","school":null,"contributors":[],"advisors":["Mamdani, Muhammad"],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-06","date_published":"2025-06","updated_at":"2026-07-27T21:28:11Z","subjects":["Algorithmic Bias","Bias","Clinical Decision Support","Clinical Medicine","Internal Medicine","Machine Learning"],"languages":[],"rights":["Attribution 4.0 International"],"rights_urls":["http://creativecommons.org/licenses/by/4.0/"],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1807/145041","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Mamdani, Muhammad"]},{"key":"dc:contributor.department","label":"Department","values":["Dalla Lana School of Public Health"]},{"key":"dc:creator","label":"Author","values":["Colacci, Michael"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-06"]},{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-07-31T15:16:15Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-07-31T15:16:15Z"]},{"key":"dc:date.issued","label":"Date","values":["2025-06"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Algorithmic Bias","Bias","Clinical Decision Support","Clinical Medicine","Internal Medicine","Machine Learning"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["Attribution 4.0 International"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://creativecommons.org/licenses/by/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1807/145041"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Clinical machine learning (ML) tools hold promise to improve patient care, though their effective implementation requires that several barriers be overcome. This thesis includes three projects designed to further understand these barriers and explore potential solutions. The first study investigated the presence and causes of sociodemographic bias in clinical ML algorithms. It found that algorithmic bias evaluations are infrequently performed, that algorithmic bias is often present, and that addressing algorithmic bias requires an approach tailored to the specific ML model and population. The second study evaluated for algorithmic bias across the development and implementation of a clinical ML tool that has been deployed into practice. This study is among the first such evaluations and identified an absence of algorithmic bias in model performance, clinical processes of care and patient outcomes for the CHARTwatch ML early warning system. This study also identified an opportunity for ML tools to be used to address pre-existing healthcare inequities, as well as outlining a roadmap for future ML implementation bias assessments. The third study evaluated how the clinical use of an ML algorithm can affect its performance over time through contamination bias. This study identified how key model parameters influence the magnitude of model performance change and explored methods to prevent model deterioration. These studies together provide strategies to identify and overcome key challenges in implementing clinical ML tools."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Ph.D."]},{"key":"dc:title","label":"Title","values":["Evaluation of Biases That Challenge the Implementation and Use of Machine Learning Clinical Decision Support Tools"]}]}],"canonical_facts":{"dc:contributor.advisor":["Mamdani, Muhammad"],"dc:contributor.department":["Dalla Lana School of Public Health"],"dc:creator":["Colacci, Michael"],"dc:date":["2025-06"],"dc:date.accessioned":["2025-07-31T15:16:15Z"],"dc:date.available":["2025-07-31T15:16:15Z"],"dc:date.issued":["2025-06"],"dc:description.abstract":["Clinical machine learning (ML) tools hold promise to improve patient care, though their effective implementation requires that several barriers be overcome. This thesis includes three projects designed to further understand these barriers and explore potential solutions. The first study investigated the presence and causes of sociodemographic bias in clinical ML algorithms. It found that algorithmic bias evaluations are infrequently performed, that algorithmic bias is often present, and that addressing algorithmic bias requires an approach tailored to the specific ML model and population. The second study evaluated for algorithmic bias across the development and implementation of a clinical ML tool that has been deployed into practice. This study is among the first such evaluations and identified an absence of algorithmic bias in model performance, clinical processes of care and patient outcomes for the CHARTwatch ML early warning system. This study also identified an opportunity for ML tools to be used to address pre-existing healthcare inequities, as well as outlining a roadmap for future ML implementation bias assessments. The third study evaluated how the clinical use of an ML algorithm can affect its performance over time through contamination bias. This study identified how key model parameters influence the magnitude of model performance change and explored methods to prevent model deterioration. These studies together provide strategies to identify and overcome key challenges in implementing clinical ML tools."],"dc:description.degree":["Ph.D."],"dc:identifier.uri":["https://hdl.handle.net/1807/145041"],"dc:rights":["Attribution 4.0 International"],"dc:rights.uri":["http://creativecommons.org/licenses/by/4.0/"],"dc:subject":["Algorithmic Bias","Bias","Clinical Decision Support","Clinical Medicine","Internal Medicine","Machine Learning"],"dc:title":["Evaluation of Biases That Challenge the Implementation and Use of Machine Learning Clinical Decision Support Tools"],"dc:type":["Thesis"]},"updated_at":"2026-07-27T21:28:11Z"}