{"id":{"repo_id":"uic","oai_identifier":"oai:figshare.com:article/32995046"},"canonical_url":"https://search.dev.ndltd.org/etd/uic/oai:figshare.com:article/32995046","repository":{"repo_id":"uic","name":"University of Illinois - Chicago","base_url":"https://api.figshare.com/v2/oai"},"display":{"title":"Automated UI Exploration of VR Environments","abstract":"Virtual Reality (VR) and Augmented Reality (AR), collectively referred to as Extended Reality (XR), are emerging technologies that have rapidly gained popularity in recent years, due to advancements in headset hardware and hand-tracking software. The spread of Extended Reality (XR), and of the so-called metaverse, is driven by the gaming industry, but these technologies are also increasingly adopted in education, healthcare, training, and industrial design. Being a relatively new technology, with standards, hardware, and capabilities continuously evolving, the ability to perform security testing and analysis of XR applications remains limited, despite the growing number of studies published in recent years. To address this gap, we propose AUTOMATRON, a novel automated testing framework driven by a scripting language designed for automatic interaction with and testing of Unity VR applications for Meta Quest 3, which is currently one of the most widely used headsets for virtual reality. Specifically, AUTOMATRON allows researchers to script application-agnostic sequences of actions at different levels of abstraction, supporting security and analysis tasks, from reproducing XR-based attacks to automating interactions with applications in order to evaluate HTTPS information exposure or uncover crashes and unexpected behaviors. A key advantage over existing tools is that AUTOMATRON allows researchers to write their own scripts, providing flexibility and extensibility for diverse testing needs. We tested the features of our language by checking their effectiveness on a set of applications collected from the official Meta Quest store. In addition, we recorded a few videos to demonstrate the effects of some AUTOMATRON scripts on selected applications.","abstract_html":"Virtual Reality (VR) and Augmented Reality (AR), collectively referred to as Extended Reality (XR), are emerging technologies that have rapidly gained popularity in recent years, due to advancements in headset hardware and hand-tracking software. The spread of Extended Reality (XR), and of the so-called metaverse, is driven by the gaming industry, but these technologies are also increasingly adopted in education, healthcare, training, and industrial design. Being a relatively new technology, with standards, hardware, and capabilities continuously evolving, the ability to perform security testing and analysis of XR applications remains limited, despite the growing number of studies published in recent years. To address this gap, we propose AUTOMATRON, a novel automated testing framework driven by a scripting language designed for automatic interaction with and testing of Unity VR applications for Meta Quest 3, which is currently one of the most widely used headsets for virtual reality. Specifically, AUTOMATRON allows researchers to script application-agnostic sequences of actions at different levels of abstraction, supporting security and analysis tasks, from reproducing XR-based attacks to automating interactions with applications in order to evaluate HTTPS information exposure or uncover crashes and unexpected behaviors. A key advantage over existing tools is that AUTOMATRON allows researchers to write their own scripts, providing flexibility and extensibility for diverse testing needs. We tested the features of our language by checking their effectiveness on a set of applications collected from the official Meta Quest store. In addition, we recorded a few videos to demonstrate the effects of some AUTOMATRON scripts on selected applications.","abstract_has_math":false,"creators":["Marco Conti (348776)"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026-05-01T00:00:00Z","date_published":"2026-05-01T00:00:00Z","updated_at":"2026-07-27T21:33:47Z","subjects":["Automated UI exploration of Unity VR Applications for Meta Quest 3"],"languages":[],"rights":["In Copyright","Open Access after 2028-05-01"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://doi.org/10.25417/uic.32995046.v1","outbound_label":"DOI","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Marco Conti (348776)"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2026-05-01T00:00:00Z"]},{"key":"dc:relation","label":"Dc Relation","values":["https://figshare.com/articles/thesis/Automated_UI_Exploration_of_VR_Environments/32995046"]},{"key":"dc:type","label":"Dc Type","values":["Text","Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Automated UI exploration of Unity VR Applications for Meta Quest 3"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright","Open Access after 2028-05-01"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["10.25417/uic.32995046.v1"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Virtual Reality (VR) and Augmented Reality (AR), collectively referred to as Extended Reality (XR), are emerging technologies that have rapidly gained popularity in recent years, due to advancements in headset hardware and hand-tracking software. The spread of Extended Reality (XR), and of the so-called metaverse, is driven by the gaming industry, but these technologies are also increasingly adopted in education, healthcare, training, and industrial design. Being a relatively new technology, with standards, hardware, and capabilities continuously evolving, the ability to perform security testing and analysis of XR applications remains limited, despite the growing number of studies published in recent years. To address this gap, we propose AUTOMATRON, a novel automated testing framework driven by a scripting language designed for automatic interaction with and testing of Unity VR applications for Meta Quest 3, which is currently one of the most widely used headsets for virtual reality. Specifically, AUTOMATRON allows researchers to script application-agnostic sequences of actions at different levels of abstraction, supporting security and analysis tasks, from reproducing XR-based attacks to automating interactions with applications in order to evaluate HTTPS information exposure or uncover crashes and unexpected behaviors. A key advantage over existing tools is that AUTOMATRON allows researchers to write their own scripts, providing flexibility and extensibility for diverse testing needs. We tested the features of our language by checking their effectiveness on a set of applications collected from the official Meta Quest store. In addition, we recorded a few videos to demonstrate the effects of some AUTOMATRON scripts on selected applications."]},{"key":"dc:title","label":"Title","values":["Automated UI Exploration of VR Environments"]}]}],"canonical_facts":{"dc:creator":["Marco Conti (348776)"],"dc:date":["2026-05-01T00:00:00Z"],"dc:description":["Virtual Reality (VR) and Augmented Reality (AR), collectively referred to as Extended Reality (XR), are emerging technologies that have rapidly gained popularity in recent years, due to advancements in headset hardware and hand-tracking software. The spread of Extended Reality (XR), and of the so-called metaverse, is driven by the gaming industry, but these technologies are also increasingly adopted in education, healthcare, training, and industrial design. Being a relatively new technology, with standards, hardware, and capabilities continuously evolving, the ability to perform security testing and analysis of XR applications remains limited, despite the growing number of studies published in recent years. To address this gap, we propose AUTOMATRON, a novel automated testing framework driven by a scripting language designed for automatic interaction with and testing of Unity VR applications for Meta Quest 3, which is currently one of the most widely used headsets for virtual reality. Specifically, AUTOMATRON allows researchers to script application-agnostic sequences of actions at different levels of abstraction, supporting security and analysis tasks, from reproducing XR-based attacks to automating interactions with applications in order to evaluate HTTPS information exposure or uncover crashes and unexpected behaviors. A key advantage over existing tools is that AUTOMATRON allows researchers to write their own scripts, providing flexibility and extensibility for diverse testing needs. We tested the features of our language by checking their effectiveness on a set of applications collected from the official Meta Quest store. In addition, we recorded a few videos to demonstrate the effects of some AUTOMATRON scripts on selected applications."],"dc:identifier":["10.25417/uic.32995046.v1"],"dc:relation":["https://figshare.com/articles/thesis/Automated_UI_Exploration_of_VR_Environments/32995046"],"dc:rights":["In Copyright","Open Access after 2028-05-01"],"dc:subject":["Automated UI exploration of Unity VR Applications for Meta Quest 3"],"dc:title":["Automated UI Exploration of VR Environments"],"dc:type":["Text","Thesis"]},"updated_at":"2026-07-27T21:33:47Z"}