{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/130101"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/130101","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Towards the effective and responsible use of imperfect NLP-generated learning content in STEM education","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","abstract_has_math":false,"creators":["Li, Wenting (Tiffany)"],"institution":"University of Illinois Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Karahalios, Karrie","Sundaram, Hari","Zilles, Craig","Kulkarni, Chinmay"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-07-15","date_published":"2025-07-15","updated_at":"2026-07-22T22:25:06Z","subjects":["Artificial Intelligence","Natural Language Processing","Personalized Learning","Autograder","Pedagogical Chatbot","Conversational Agent","Error Management","Differential Impact","Fairness","Hallucination","Reliance","Stem Learning","Large Language Model"],"languages":["en","eng"],"rights":["Copyright 2025 Wenting (Tiffany) Li"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/130101","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Karahalios, Karrie","Sundaram, Hari","Zilles, Craig","Kulkarni, Chinmay"]},{"key":"dc:creator","label":"Author","values":["Li, Wenting (Tiffany)"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-07-15","2025-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Artificial Intelligence","Natural Language Processing","Personalized Learning","Autograder","Pedagogical Chatbot","Conversational Agent","Error Management","Differential Impact","Fairness","Hallucination","Reliance","Stem Learning","Large Language Model"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Wenting (Tiffany) Li"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/130101"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","The student, Wenting (Tiffany) Li, accepted the attached license on 2025-07-15 at 09:58.","The student, Wenting (Tiffany) Li, submitted this Dissertation for approval on 2025-07-15 at 10:13.","This Dissertation was approved for publication on 2025-07-15 at 14:55.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22574 on 2025-10-25 at 15:31:01","Artificial intelligence (AI) has been a building block to provide adaptive instruction and learning support at scale since the 1970s. In the past decades, researchers have mainly relied on knowledge-based AI to construct a domain model for learner-facing interactive personalized instruction systems, i.e., encoding task domain knowledge in symbols, logic, and rules. More recently, the use of data-driven AI to extract domain knowledge from data has gained attention due to its potential to better represent domains with open or changing worlds, reduce expert-authoring costs, and broaden the scope of user interaction. However, the learning content created based on a data-driven AI domain model is much more likely to contain inaccurate or incomplete information. This has raised concerns about its use, especially since it has become more accessible after the public launch of ChatGPT and similar tools. Should we deploy a system that uses imperfect AI-generated learning content, given its potential harm? If so, how should we design and deploy it effectively and responsibly? To provide insights into these questions, I systematically investigated how adult learners perceive, interact with, and get impacted by imperfect AI-generated content in STEM learning. My dissertation focuses on two types of learning content created with Natural Language Processing (NLP) techniques: (1) formative correctness feedback for short-answer questions and (2) natural language responses to learner-initiated interactive help-seeking. Using a socio-technical lens and a mixed-methods approach, I contributed actionable recommendations on learner support, system design, and system deployment to help diverse learners gain the most from imperfect AI-generated learning content. The dissertation further demonstrates the need to use caution when deploying such imperfect content and provides guidelines for conducting impact assessments before deployment."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Towards the effective and responsible use of imperfect NLP-generated learning content in STEM education"]}]}],"canonical_facts":{"dc:contributor":["Karahalios, Karrie","Sundaram, Hari","Zilles, Craig","Kulkarni, Chinmay"],"dc:creator":["Li, Wenting (Tiffany)"],"dc:date":["2025-07-15","2025-08"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-08-01","The student, Wenting (Tiffany) Li, accepted the attached license on 2025-07-15 at 09:58.","The student, Wenting (Tiffany) Li, submitted this Dissertation for approval on 2025-07-15 at 10:13.","This Dissertation was approved for publication on 2025-07-15 at 14:55.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22574 on 2025-10-25 at 15:31:01","Artificial intelligence (AI) has been a building block to provide adaptive instruction and learning support at scale since the 1970s. In the past decades, researchers have mainly relied on knowledge-based AI to construct a domain model for learner-facing interactive personalized instruction systems, i.e., encoding task domain knowledge in symbols, logic, and rules. More recently, the use of data-driven AI to extract domain knowledge from data has gained attention due to its potential to better represent domains with open or changing worlds, reduce expert-authoring costs, and broaden the scope of user interaction. However, the learning content created based on a data-driven AI domain model is much more likely to contain inaccurate or incomplete information. This has raised concerns about its use, especially since it has become more accessible after the public launch of ChatGPT and similar tools. Should we deploy a system that uses imperfect AI-generated learning content, given its potential harm? If so, how should we design and deploy it effectively and responsibly? To provide insights into these questions, I systematically investigated how adult learners perceive, interact with, and get impacted by imperfect AI-generated content in STEM learning. My dissertation focuses on two types of learning content created with Natural Language Processing (NLP) techniques: (1) formative correctness feedback for short-answer questions and (2) natural language responses to learner-initiated interactive help-seeking. Using a socio-technical lens and a mixed-methods approach, I contributed actionable recommendations on learner support, system design, and system deployment to help diverse learners gain the most from imperfect AI-generated learning content. The dissertation further demonstrates the need to use caution when deploying such imperfect content and provides guidelines for conducting impact assessments before deployment."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/130101"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Wenting (Tiffany) Li"],"dc:subject":["Artificial Intelligence","Natural Language Processing","Personalized Learning","Autograder","Pedagogical Chatbot","Conversational Agent","Error Management","Differential Impact","Fairness","Hallucination","Reliance","Stem Learning","Large Language Model"],"dc:title":["Towards the effective and responsible use of imperfect NLP-generated learning content in STEM education"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:06Z"}