{"id":{"repo_id":"vt","oai_identifier":"oai:vtechworks.lib.vt.edu:10919/137624"},"canonical_url":"https://search.dev.ndltd.org/etd/vt/oai:vtechworks.lib.vt.edu:10919/137624","repository":{"repo_id":"vt","name":"Virginia Tech","base_url":"https://vtechworks.lib.vt.edu/oai/request"},"display":{"title":"The Effect of Sonification in Informal Learning: From Fairy Tales to Art Galleries","abstract":"As technology continues to advance in the present era, lifelong learning has become essential across all stages of life. Learning occurs not only in formal institutional settings but also in informal contexts embedded in daily life. Within these informal learning environments, sonification can play a pivotal role by facilitating learning through auditory interaction, interpretation, and engagement. However, the effectiveness of sonification can vary based on contextual factors and individual capabilities. To investigate the potential of sonification in informal learning, this dissertation presents four empirical studies across two domains: human-robot interaction (HRI) and art appreciation in gallery settings. The first study examined how emotion-reflecting sonification, compared to emotion mitigating sonification, influences the experience of listening to fairy tales, focusing on participants' enjoyment, empathy, and immersion. The second study compared sentiment based sonification with classical music in robot storytelling, evaluating their impact on comprehension, emotional interpretation, and engagement. The third study investigated the role of Augmented Audio in an art gallery environment, assessing its influence on participants' emotional responses and engagement during art appreciation. The fourth study explored how Augmented Audio and Augmented Visual elements influence comprehension, emotional reaction, and sustained engagement with artworks. Collectively, this dissertation offers insights into how sonification can be effectively applied across varied informal learning contexts, from narrative storytelling to visual art appreciation, to foster immersive, emotionally resonant, and cognitively enriching educational experiences.","abstract_html":"As technology continues to advance in the present era, lifelong learning has become essential across all stages of life. Learning occurs not only in formal institutional settings but also in informal contexts embedded in daily life. Within these informal learning environments, sonification can play a pivotal role by facilitating learning through auditory interaction, interpretation, and engagement. However, the effectiveness of sonification can vary based on contextual factors and individual capabilities. To investigate the potential of sonification in informal learning, this dissertation presents four empirical studies across two domains: human-robot interaction (HRI) and art appreciation in gallery settings. The first study examined how emotion-reflecting sonification, compared to emotion mitigating sonification, influences the experience of listening to fairy tales, focusing on participants' enjoyment, empathy, and immersion. The second study compared sentiment based sonification with classical music in robot storytelling, evaluating their impact on comprehension, emotional interpretation, and engagement. The third study investigated the role of Augmented Audio in an art gallery environment, assessing its influence on participants' emotional responses and engagement during art appreciation. The fourth study explored how Augmented Audio and Augmented Visual elements influence comprehension, emotional reaction, and sustained engagement with artworks. Collectively, this dissertation offers insights into how sonification can be effectively applied across varied informal learning contexts, from narrative storytelling to visual art appreciation, to foster immersive, emotionally resonant, and cognitively enriching educational experiences.","abstract_has_math":false,"creators":["Lee, Yeaji"],"institution":"Virginia Tech","degree_name":"Doctor of Philosophy","degree_level":"doctoral","degree_discipline":"Industrial and Systems Engineering","degree_department":"Industrial and Systems Engineering","school":null,"contributors":[],"advisors":[],"committee_chairs":["Jeon, Myounghoon"],"committee_members":["Lee, Sang Won","Dickerson, Deborah Elspeth","Roofigari-Esfahan, Nazila"],"year":2025,"date_issued":"2025-09-04","date_published":"2025-09-04","updated_at":"2026-07-22T22:20:16Z","subjects":["sonification","informal learning"],"languages":["en"],"rights":["In Copyright"],"rights_urls":["http://rightsstatements.org/vocab/InC/1.0/"],"identifier_entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["vt_gsexam:44530"],"render_values":[{"text":"vt_gsexam:44530","href":null,"code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/10919/137624","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.committeechair","label":"Committee Chair","values":["Jeon, Myounghoon"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Lee, Sang Won","Dickerson, Deborah Elspeth","Roofigari-Esfahan, Nazila"]},{"key":"dc:contributor.department","label":"Department","values":["Industrial and Systems Engineering"]},{"key":"dc:creator","label":"Author","values":["Lee, Yeaji"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-09-05T08:00:59Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-09-05T08:00:59Z"]},{"key":"dc:date.issued","label":"Date","values":["2025-09-04"]},{"key":"dc:publisher","label":"Institution","values":["Virginia Tech"]},{"key":"dc:type","label":"Dc Type","values":["Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Industrial and Systems Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["doctoral"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Virginia Polytechnic Institute and State University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["sonification","informal learning"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["In Copyright"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://rightsstatements.org/vocab/InC/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["vt_gsexam:44530"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/10919/137624"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["As technology continues to advance in the present era, lifelong learning has become essential across all stages of life. Learning occurs not only in formal institutional settings but also in informal contexts embedded in daily life. Within these informal learning environments, sonification can play a pivotal role by facilitating learning through auditory interaction, interpretation, and engagement. However, the effectiveness of sonification can vary based on contextual factors and individual capabilities. To investigate the potential of sonification in informal learning, this dissertation presents four empirical studies across two domains: human-robot interaction (HRI) and art appreciation in gallery settings. The first study examined how emotion-reflecting sonification, compared to emotion mitigating sonification, influences the experience of listening to fairy tales, focusing on participants' enjoyment, empathy, and immersion. The second study compared sentiment based sonification with classical music in robot storytelling, evaluating their impact on comprehension, emotional interpretation, and engagement. The third study investigated the role of Augmented Audio in an art gallery environment, assessing its influence on participants' emotional responses and engagement during art appreciation. The fourth study explored how Augmented Audio and Augmented Visual elements influence comprehension, emotional reaction, and sustained engagement with artworks. Collectively, this dissertation offers insights into how sonification can be effectively applied across varied informal learning contexts, from narrative storytelling to visual art appreciation, to foster immersive, emotionally resonant, and cognitively enriching educational experiences."]},{"key":"dc:description.abstractgeneral","label":"General Abstract","values":["As technology continues to advance in the present era, lifelong learning has become essential across all stages of life. Learning occurs not only in formal institutional settings but also in informal contexts embedded in daily life. Within these informal learning environments, sonification plays a pivotal role by facilitating learning through auditory interaction, interpretation, and engagement. However, the effectiveness of sonification can vary based on contextual factors and individual capabilities. To explore the potential of sonification in informal learning, this dissertation presents four empirical studies examining its effectiveness across two domains: human-robot interaction (HRI) and art appreciation in gallery settings. Collectively, this dissertation offers insights into how sonification can be meaningfully applied across diverse informal learning contexts, from narrative storytelling to visual art appreciation, to foster immersive, emotionally resonant, and cognitively enriching educational experiences."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Doctor of Philosophy"]},{"key":"dc:format.medium","label":"Dc Format Medium","values":["ETD"]},{"key":"dc:title","label":"Title","values":["The Effect of Sonification in Informal Learning: From Fairy Tales to Art Galleries"]}]}],"canonical_facts":{"dc:contributor.committeechair":["Jeon, Myounghoon"],"dc:contributor.committeemember":["Lee, Sang Won","Dickerson, Deborah Elspeth","Roofigari-Esfahan, Nazila"],"dc:contributor.department":["Industrial and Systems Engineering"],"dc:creator":["Lee, Yeaji"],"dc:date.accessioned":["2025-09-05T08:00:59Z"],"dc:date.available":["2025-09-05T08:00:59Z"],"dc:date.issued":["2025-09-04"],"dc:description.abstract":["As technology continues to advance in the present era, lifelong learning has become essential across all stages of life. Learning occurs not only in formal institutional settings but also in informal contexts embedded in daily life. Within these informal learning environments, sonification can play a pivotal role by facilitating learning through auditory interaction, interpretation, and engagement. However, the effectiveness of sonification can vary based on contextual factors and individual capabilities. To investigate the potential of sonification in informal learning, this dissertation presents four empirical studies across two domains: human-robot interaction (HRI) and art appreciation in gallery settings. The first study examined how emotion-reflecting sonification, compared to emotion mitigating sonification, influences the experience of listening to fairy tales, focusing on participants' enjoyment, empathy, and immersion. The second study compared sentiment based sonification with classical music in robot storytelling, evaluating their impact on comprehension, emotional interpretation, and engagement. The third study investigated the role of Augmented Audio in an art gallery environment, assessing its influence on participants' emotional responses and engagement during art appreciation. The fourth study explored how Augmented Audio and Augmented Visual elements influence comprehension, emotional reaction, and sustained engagement with artworks. Collectively, this dissertation offers insights into how sonification can be effectively applied across varied informal learning contexts, from narrative storytelling to visual art appreciation, to foster immersive, emotionally resonant, and cognitively enriching educational experiences."],"dc:description.abstractgeneral":["As technology continues to advance in the present era, lifelong learning has become essential across all stages of life. Learning occurs not only in formal institutional settings but also in informal contexts embedded in daily life. Within these informal learning environments, sonification plays a pivotal role by facilitating learning through auditory interaction, interpretation, and engagement. However, the effectiveness of sonification can vary based on contextual factors and individual capabilities. To explore the potential of sonification in informal learning, this dissertation presents four empirical studies examining its effectiveness across two domains: human-robot interaction (HRI) and art appreciation in gallery settings. Collectively, this dissertation offers insights into how sonification can be meaningfully applied across diverse informal learning contexts, from narrative storytelling to visual art appreciation, to foster immersive, emotionally resonant, and cognitively enriching educational experiences."],"dc:description.degree":["Doctor of Philosophy"],"dc:format.medium":["ETD"],"dc:identifier.other":["vt_gsexam:44530"],"dc:identifier.uri":["https://hdl.handle.net/10919/137624"],"dc:language.iso":["en"],"dc:publisher":["Virginia Tech"],"dc:rights":["In Copyright"],"dc:rights.uri":["http://rightsstatements.org/vocab/InC/1.0/"],"dc:subject":["sonification","informal learning"],"dc:title":["The Effect of Sonification in Informal Learning: From Fairy Tales to Art Galleries"],"dc:type":["Dissertation"],"thesis:degree_discipline":["Industrial and Systems Engineering"],"thesis:degree_level":["doctoral"],"thesis:degree_name":["Doctor of Philosophy"],"thesis:institution_name":["Virginia Polytechnic Institute and State University"]},"updated_at":"2026-07-22T22:20:16Z"}