{"id":{"repo_id":"umn","oai_identifier":"oai:conservancy.umn.edu:11299/275855"},"canonical_url":"https://search.dev.ndltd.org/etd/umn/oai:conservancy.umn.edu:11299/275855","repository":{"repo_id":"umn","name":"University of Minnesota","base_url":"https://conservancy.umn.edu/server/oai/request"},"display":{"title":"EXCEED: enabling and excelling equitable evidence generation for digital health.","abstract":"The merger of technology and healthcare has given rise to a new era of evidence-based medicine. Digital health technologies (DHTs), defined in 2022 as “systems that use computing platforms, connectivity, software, and/or sensors for healthcare and related uses,” have become rapidly incorporated across medical specialties on a global scale. Randomized controlled trials (RCTs), considered the gold standard of evidence generation, are used by regulators to assess the safety and efficacy of proposed DHTs prior to translation into clinical practice. However, the ubiquity and diversity of DHTs present challenges in quantifying the current scope of DHT-enabled RCTs. To ensure a balance between innovation and safety in DHT-enabled RCTs, two critical elements must be comprehensively assessed: 1) the representativeness of participant populations in which DHTs are trialed, and 2) the impact of reporting heterogeneity on safe and equitable translation of findings. Recent advances in generative artificial intelligence present an opportunity for machine-assisted evidence synthesis leveraging large language models (LLMs). Prompt engineering uses natural language to instruct LLMs in performing tasks such as classification and information extraction. These capabilities can be applied to literature review tasks, such as article eligibility screening, full-text review, and adherence evaluations. However, preprocessing files and establishing standardized LLM techniques for real-world evidence generation inclusive of time, technology type, and health specialty has not previously been developed to analyze DHT-enabled RCTs. In this work, we propose the EXCEED framework to accelerate LLM-assisted evidence synthesis, achieving scientific rigor on par with human annotators. We then apply the framework to assess the rapid growth of DHT-enabled RCTs and assess the impacts of reporting heterogeneity on equitable evaluation of digital medicine. In the following chapters, we propose: 1) information extraction definitions for DHT-enabled clinical trials, 2) a feasibility study of multi-purpose LLMs evaluated on classification and information extraction tasks, 3) the EXCEED framework for LLM-assisted evidence synthesis application of the framework in two case studies, 4) a modified-Delphi study of expert recommendations for validation of DHT-enabled RCT reporting items, and 5) DHT-enabled RCTs reporting recommendations based on mixed-methods, data-drive evidence.","abstract_html":"The merger of technology and healthcare has given rise to a new era of evidence-based medicine. Digital health technologies (DHTs), defined in 2022 as “systems that use computing platforms, connectivity, software, and/or sensors for healthcare and related uses,” have become rapidly incorporated across medical specialties on a global scale. Randomized controlled trials (RCTs), considered the gold standard of evidence generation, are used by regulators to assess the safety and efficacy of proposed DHTs prior to translation into clinical practice. However, the ubiquity and diversity of DHTs present challenges in quantifying the current scope of DHT-enabled RCTs. To ensure a balance between innovation and safety in DHT-enabled RCTs, two critical elements must be comprehensively assessed: 1) the representativeness of participant populations in which DHTs are trialed, and 2) the impact of reporting heterogeneity on safe and equitable translation of findings. Recent advances in generative artificial intelligence present an opportunity for machine-assisted evidence synthesis leveraging large language models (LLMs). Prompt engineering uses natural language to instruct LLMs in performing tasks such as classification and information extraction. These capabilities can be applied to literature review tasks, such as article eligibility screening, full-text review, and adherence evaluations. However, preprocessing files and establishing standardized LLM techniques for real-world evidence generation inclusive of time, technology type, and health specialty has not previously been developed to analyze DHT-enabled RCTs. In this work, we propose the EXCEED framework to accelerate LLM-assisted evidence synthesis, achieving scientific rigor on par with human annotators. We then apply the framework to assess the rapid growth of DHT-enabled RCTs and assess the impacts of reporting heterogeneity on equitable evaluation of digital medicine. In the following chapters, we propose: 1) information extraction definitions for DHT-enabled clinical trials, 2) a feasibility study of multi-purpose LLMs evaluated on classification and information extraction tasks, 3) the EXCEED framework for LLM-assisted evidence synthesis application of the framework in two case studies, 4) a modified-Delphi study of expert recommendations for validation of DHT-enabled RCT reporting items, and 5) DHT-enabled RCTs reporting recommendations based on mixed-methods, data-drive evidence.","abstract_has_math":false,"creators":["Harrison, Taylor"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-04","date_published":"2025-04","updated_at":"2026-07-24T05:20:07Z","subjects":["Clinical Trials","Digital Health Equity","Digital Health Technologies","Health Informatics","Large Language Models","Reporting Standards"],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/11299/275855","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Harrison, Taylor"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-08-25T12:13:07Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-08-25T12:13:07Z"]},{"key":"dc:date.issued","label":"Date","values":["2025-04"]},{"key":"dc:type","label":"Dc Type","values":["Thesis or Dissertation"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Clinical Trials","Digital Health Equity","Digital Health Technologies","Health Informatics","Large Language Models","Reporting Standards"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/11299/275855"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["University of Minnesota Ph.D. dissertation. April 2025. Major: Biomedical Informatics and Computational Biology. Advisors: Hongfang Liu, Yuk Sham. 1 computer file (PDF); xi, 128 pages."]},{"key":"dc:description.abstract","label":"Abstract","values":["The merger of technology and healthcare has given rise to a new era of evidence-based medicine. Digital health technologies (DHTs), defined in 2022 as “systems that use computing platforms, connectivity, software, and/or sensors for healthcare and related uses,” have become rapidly incorporated across medical specialties on a global scale. Randomized controlled trials (RCTs), considered the gold standard of evidence generation, are used by regulators to assess the safety and efficacy of proposed DHTs prior to translation into clinical practice. However, the ubiquity and diversity of DHTs present challenges in quantifying the current scope of DHT-enabled RCTs. To ensure a balance between innovation and safety in DHT-enabled RCTs, two critical elements must be comprehensively assessed: 1) the representativeness of participant populations in which DHTs are trialed, and 2) the impact of reporting heterogeneity on safe and equitable translation of findings. Recent advances in generative artificial intelligence present an opportunity for machine-assisted evidence synthesis leveraging large language models (LLMs). Prompt engineering uses natural language to instruct LLMs in performing tasks such as classification and information extraction. These capabilities can be applied to literature review tasks, such as article eligibility screening, full-text review, and adherence evaluations. However, preprocessing files and establishing standardized LLM techniques for real-world evidence generation inclusive of time, technology type, and health specialty has not previously been developed to analyze DHT-enabled RCTs. In this work, we propose the EXCEED framework to accelerate LLM-assisted evidence synthesis, achieving scientific rigor on par with human annotators. We then apply the framework to assess the rapid growth of DHT-enabled RCTs and assess the impacts of reporting heterogeneity on equitable evaluation of digital medicine. In the following chapters, we propose: 1) information extraction definitions for DHT-enabled clinical trials, 2) a feasibility study of multi-purpose LLMs evaluated on classification and information extraction tasks, 3) the EXCEED framework for LLM-assisted evidence synthesis application of the framework in two case studies, 4) a modified-Delphi study of expert recommendations for validation of DHT-enabled RCT reporting items, and 5) DHT-enabled RCTs reporting recommendations based on mixed-methods, data-drive evidence."]},{"key":"dc:title","label":"Title","values":["EXCEED: enabling and excelling equitable evidence generation for digital health."]}]}],"canonical_facts":{"dc:creator":["Harrison, Taylor"],"dc:date.accessioned":["2025-08-25T12:13:07Z"],"dc:date.available":["2025-08-25T12:13:07Z"],"dc:date.issued":["2025-04"],"dc:description":["University of Minnesota Ph.D. dissertation. April 2025. Major: Biomedical Informatics and Computational Biology. Advisors: Hongfang Liu, Yuk Sham. 1 computer file (PDF); xi, 128 pages."],"dc:description.abstract":["The merger of technology and healthcare has given rise to a new era of evidence-based medicine. Digital health technologies (DHTs), defined in 2022 as “systems that use computing platforms, connectivity, software, and/or sensors for healthcare and related uses,” have become rapidly incorporated across medical specialties on a global scale. Randomized controlled trials (RCTs), considered the gold standard of evidence generation, are used by regulators to assess the safety and efficacy of proposed DHTs prior to translation into clinical practice. However, the ubiquity and diversity of DHTs present challenges in quantifying the current scope of DHT-enabled RCTs. To ensure a balance between innovation and safety in DHT-enabled RCTs, two critical elements must be comprehensively assessed: 1) the representativeness of participant populations in which DHTs are trialed, and 2) the impact of reporting heterogeneity on safe and equitable translation of findings. Recent advances in generative artificial intelligence present an opportunity for machine-assisted evidence synthesis leveraging large language models (LLMs). Prompt engineering uses natural language to instruct LLMs in performing tasks such as classification and information extraction. These capabilities can be applied to literature review tasks, such as article eligibility screening, full-text review, and adherence evaluations. However, preprocessing files and establishing standardized LLM techniques for real-world evidence generation inclusive of time, technology type, and health specialty has not previously been developed to analyze DHT-enabled RCTs. In this work, we propose the EXCEED framework to accelerate LLM-assisted evidence synthesis, achieving scientific rigor on par with human annotators. We then apply the framework to assess the rapid growth of DHT-enabled RCTs and assess the impacts of reporting heterogeneity on equitable evaluation of digital medicine. In the following chapters, we propose: 1) information extraction definitions for DHT-enabled clinical trials, 2) a feasibility study of multi-purpose LLMs evaluated on classification and information extraction tasks, 3) the EXCEED framework for LLM-assisted evidence synthesis application of the framework in two case studies, 4) a modified-Delphi study of expert recommendations for validation of DHT-enabled RCT reporting items, and 5) DHT-enabled RCTs reporting recommendations based on mixed-methods, data-drive evidence."],"dc:identifier.uri":["https://hdl.handle.net/11299/275855"],"dc:language.iso":["en"],"dc:subject":["Clinical Trials","Digital Health Equity","Digital Health Technologies","Health Informatics","Large Language Models","Reporting Standards"],"dc:title":["EXCEED: enabling and excelling equitable evidence generation for digital health."],"dc:type":["Thesis or Dissertation"]},"updated_at":"2026-07-24T05:20:07Z"}