{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/120280"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/120280","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Seeing us through machines: designing and building conversational AI to understand humans","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","abstract_has_math":false,"creators":["Xiao, Ziang"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Sundaram, Hari","Karahalios, Karrie","Zhou, Michelle X.","Ji, Heng","Roberts, Brent W."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-05","date_published":"2023-05","updated_at":"2026-07-22T22:24:57Z","subjects":["Understanding Human","Conversational Ai","Artificial Intelligence","Human-computer Interaction","Natural Language Processing","Survey","Informed Consent","Voice Interaction","Personality"],"languages":["en","eng"],"rights":["Copyright 2023 Ziang Xiao"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/120280","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Sundaram, Hari","Karahalios, Karrie","Zhou, Michelle X.","Ji, Heng","Roberts, Brent W."]},{"key":"dc:creator","label":"Author","values":["Xiao, Ziang"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-05","2023-04-21"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Understanding Human","Conversational Ai","Artificial Intelligence","Human-computer Interaction","Natural Language Processing","Survey","Informed Consent","Voice Interaction","Personality"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2023 Ziang Xiao"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/120280"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","The student, Ziang Xiao, accepted the attached license on 2023-04-17 at 15:57.","The student, Ziang Xiao, submitted this Dissertation for approval on 2023-04-17 at 19:15.","This Dissertation was approved for publication on 2023-04-21 at 14:16.","DSpace SAF Submission Ingestion Package generated from Vireo submission #19018 on 2023-09-01 at 17:08:51","Understanding humans at scale is essential for addressing some of the consequential challenges in human society. By gaining insights into why people act as they do, we can design informed interventions that have a positive societal impact, including improving public health, developing a sustainable economy, or advancing fair education. However, the complexity of human behavior necessitates novel and sophisticated tools and methods to capture cultural, social, environmental, and individual characteristics that heavily influence our behaviors. Further, understanding ethical concerns surrounding informed consent, privacy, and data collection requires interdisciplinary expertise and is essential to study human behavior responsibly. In this dissertation, we take up this challenge by exploring the use of Artificial Intelligence (AI) in the context of behavioral science studies, designing and building effective conversational AIs for information collection and informed consent. This thesis starts by focusing on surveys, one of the most widely-used research methods in behavioral research. We studied conversational AIs to address today's survey research challenges: survey fatigue, inflexible survey structure, and lack of personalization. In an AI-driven conversational survey, a conversational agent asks questions, interprets a participant's responses, and probes answers whenever needed. We first studied an AI-driven conversational survey's response quality and participant engagement by comparing it with form-based surveys. After establishing the promise, We improved a conversational survey by equipping the AI agent with active listening skills through a human-in-the-loop framework. We further built a novel knowledge-driven language model to generate informative follow-up questions on the fly. We then looked at the ethical practices in behavioral science research, informed consent procedure, in online studies. Due to the lack of a researcher's presence and guidance, online participants often failed to make informed participation decisions, putting them at unaware risks. In this study, we re-introduced interactivity to online informed consent using conversational AI. Our agent guided participants through the consent form step-by-step and answered their questions. Compared to the form-based interaction, we found the AI-powered chatbot improved consent form reading, promoted participants’ feelings of agency, closed the power gap between the participant and the researcher, and ultimately benefited the study quality. We ended this thesis with a series of empirical studies about how people interact with such conversational AIs. Drawing from the rich use of voice assistants, we considered voice as another modality. We studied how voice assistants with different social metaphors influence people's reactions and perceptions of their information requests. We then deployed a conversational AI in the real world to collect students' team preferences and demonstrated how such an agent improves the student teaming experience. This dissertation provides both empirical evidence of how to design effective conversational AI to understand human behavior at scale and technical frameworks to build such an agent. Most importantly, it contributes to design implications for future technologies to improve our understanding of how we interact with each other and our environment and push this research field forward."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Seeing us through machines: designing and building conversational AI to understand humans"]}]}],"canonical_facts":{"dc:contributor":["Sundaram, Hari","Karahalios, Karrie","Zhou, Michelle X.","Ji, Heng","Roberts, Brent W."],"dc:creator":["Xiao, Ziang"],"dc:date":["2023-05","2023-04-21"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","The student, Ziang Xiao, accepted the attached license on 2023-04-17 at 15:57.","The student, Ziang Xiao, submitted this Dissertation for approval on 2023-04-17 at 19:15.","This Dissertation was approved for publication on 2023-04-21 at 14:16.","DSpace SAF Submission Ingestion Package generated from Vireo submission #19018 on 2023-09-01 at 17:08:51","Understanding humans at scale is essential for addressing some of the consequential challenges in human society. By gaining insights into why people act as they do, we can design informed interventions that have a positive societal impact, including improving public health, developing a sustainable economy, or advancing fair education. However, the complexity of human behavior necessitates novel and sophisticated tools and methods to capture cultural, social, environmental, and individual characteristics that heavily influence our behaviors. Further, understanding ethical concerns surrounding informed consent, privacy, and data collection requires interdisciplinary expertise and is essential to study human behavior responsibly. In this dissertation, we take up this challenge by exploring the use of Artificial Intelligence (AI) in the context of behavioral science studies, designing and building effective conversational AIs for information collection and informed consent. This thesis starts by focusing on surveys, one of the most widely-used research methods in behavioral research. We studied conversational AIs to address today's survey research challenges: survey fatigue, inflexible survey structure, and lack of personalization. In an AI-driven conversational survey, a conversational agent asks questions, interprets a participant's responses, and probes answers whenever needed. We first studied an AI-driven conversational survey's response quality and participant engagement by comparing it with form-based surveys. After establishing the promise, We improved a conversational survey by equipping the AI agent with active listening skills through a human-in-the-loop framework. We further built a novel knowledge-driven language model to generate informative follow-up questions on the fly. We then looked at the ethical practices in behavioral science research, informed consent procedure, in online studies. Due to the lack of a researcher's presence and guidance, online participants often failed to make informed participation decisions, putting them at unaware risks. In this study, we re-introduced interactivity to online informed consent using conversational AI. Our agent guided participants through the consent form step-by-step and answered their questions. Compared to the form-based interaction, we found the AI-powered chatbot improved consent form reading, promoted participants’ feelings of agency, closed the power gap between the participant and the researcher, and ultimately benefited the study quality. We ended this thesis with a series of empirical studies about how people interact with such conversational AIs. Drawing from the rich use of voice assistants, we considered voice as another modality. We studied how voice assistants with different social metaphors influence people's reactions and perceptions of their information requests. We then deployed a conversational AI in the real world to collect students' team preferences and demonstrated how such an agent improves the student teaming experience. This dissertation provides both empirical evidence of how to design effective conversational AI to understand human behavior at scale and technical frameworks to build such an agent. Most importantly, it contributes to design implications for future technologies to improve our understanding of how we interact with each other and our environment and push this research field forward."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/120280"],"dc:language":["en","eng"],"dc:rights":["Copyright 2023 Ziang Xiao"],"dc:subject":["Understanding Human","Conversational Ai","Artificial Intelligence","Human-computer Interaction","Natural Language Processing","Survey","Informed Consent","Voice Interaction","Personality"],"dc:title":["Seeing us through machines: designing and building conversational AI to understand humans"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:57Z"}