{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/115901"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/115901","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Empowering automated mobile UI testing with external support","abstract":"Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-08-01","abstract_html":"Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-08-01","abstract_has_math":false,"creators":["Wang, Wenyu"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Xie, Tao","Marinov, Darko","Xu, Tianyin","Prasad, Mukul"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-08","date_published":"2022-08","updated_at":"2026-07-22T22:24:55Z","subjects":["UI testing","software testing","mobile app"],"languages":["en","eng"],"rights":["© 2022 Wenyu Wang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/115901","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Xie, Tao","Marinov, Darko","Xu, Tianyin","Prasad, Mukul"]},{"key":"dc:creator","label":"Author","values":["Wang, Wenyu"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-08","2022-07-08"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["UI testing","software testing","mobile app"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["© 2022 Wenyu Wang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/115901"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-08-01","The student, Wenyu Wang, accepted the attached license on 2022-07-07 at 18:01.","The student, Wenyu Wang, submitted this Dissertation for approval on 2022-07-07 at 18:29.","This Dissertation was approved for publication on 2022-07-08 at 12:43.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18179 on 2022-11-16 at 10:18:02","While mobile devices have become an integral part of modern daily life, the ever-growing complexity and fast pace of app feature development have imposed unprecedented challenges on making these mobile apps robust and reliable. User Interface (UI), as the primary medium of user interactions, is naturally a good entry point for testing mobile apps. While manual and scripted UI testing is a common practice, automated UI testing is becoming increasingly popular. By mimicking how human users interact with apps through the UIs, automated UI test generation tools are capable of detecting reliability and usability issues, complementing manual and scripted testing by requiring little to no human testing effort. There have been numerous mobile UI test generation tools from both the research community and industry after years of development, mainly focusing on designing novel exploration algorithms on the Android platform. Despite showing the best overall test effectiveness in their own evaluation settings, most of the existing tools are found to barely outperform a baseline tool, Monkey, when evaluated upon comprehensive sets of Android apps. The observation is made by independent measurement studies (including one described in this dissertation) involving both relatively simple open-source apps and popular, complex industrial apps. The finding, contradicting researchers’ common belief, suggests a significant effectiveness gap that needs to be filled for automated mobile UI testing, especially on industrial apps with generally high impacts. Aiming to understand the aforementioned effectiveness gap, we empirically investigate the test process and results from our measurement study, yielding three relevant findings: (1) there is no “silver-bullet” tool that outperforms all other tools on every app, suggesting that it is difficult to build a single tool that adapts well to different apps with diverse UI designs; (2) a tool’s test effectiveness is not solely decided by its exploration algorithm, and the tool’s implementation also makes differences; (3) it is possible to enhance the design or the implementation of different tools using unified approaches. In the context of existing work’s focus on designing novel exploration algorithms, our findings suggest that it is worthwhile to develop complementary techniques that enhance existing tools to unleash the power of different exploration algorithms on various complex industrial apps. Inspired by the aforementioned findings, this dissertation presents three parts of research that explore the possibilities for existing automated UI test generation tools to be empowered with external automated support (i.e., techniques that are applicable to various tools while keeping them fully automatic). These parts of work enhance different components in the workflow of automated Android UI test generation tools. The first part (TOLLER) focuses on enhancing infrastructure support that enables a tool’s exploration algorithm to obtain states from and execute actions on the test device, allowing the tool to iterate faster and cover more App Under Test (AUT) functionalities within limited time. The second part (VET) focuses on providing exploration guidance for a tool on a specific AUT, based on our observation that a tool’s exploration algorithm or implementation might have applicability issues in certain conditions. The third part (EPIT) focuses on parallelization coordination for a tool and a specific AUT on multiple test devices to improve the overall test effectiveness or reduce testing costs by reducing overlapped explorations. Our evaluations show that the proposed techniques can help state-of-the-art automated Android UI test generation tools achieve substantially better test effectiveness or reduce testing costs on popular and complex industrial apps."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Empowering automated mobile UI testing with external support"]}]}],"canonical_facts":{"dc:contributor":["Xie, Tao","Marinov, Darko","Xu, Tianyin","Prasad, Mukul"],"dc:creator":["Wang, Wenyu"],"dc:date":["2022-08","2022-07-08"],"dc:description":["Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2024-08-01","The student, Wenyu Wang, accepted the attached license on 2022-07-07 at 18:01.","The student, Wenyu Wang, submitted this Dissertation for approval on 2022-07-07 at 18:29.","This Dissertation was approved for publication on 2022-07-08 at 12:43.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18179 on 2022-11-16 at 10:18:02","While mobile devices have become an integral part of modern daily life, the ever-growing complexity and fast pace of app feature development have imposed unprecedented challenges on making these mobile apps robust and reliable. User Interface (UI), as the primary medium of user interactions, is naturally a good entry point for testing mobile apps. While manual and scripted UI testing is a common practice, automated UI testing is becoming increasingly popular. By mimicking how human users interact with apps through the UIs, automated UI test generation tools are capable of detecting reliability and usability issues, complementing manual and scripted testing by requiring little to no human testing effort. There have been numerous mobile UI test generation tools from both the research community and industry after years of development, mainly focusing on designing novel exploration algorithms on the Android platform. Despite showing the best overall test effectiveness in their own evaluation settings, most of the existing tools are found to barely outperform a baseline tool, Monkey, when evaluated upon comprehensive sets of Android apps. The observation is made by independent measurement studies (including one described in this dissertation) involving both relatively simple open-source apps and popular, complex industrial apps. The finding, contradicting researchers’ common belief, suggests a significant effectiveness gap that needs to be filled for automated mobile UI testing, especially on industrial apps with generally high impacts. Aiming to understand the aforementioned effectiveness gap, we empirically investigate the test process and results from our measurement study, yielding three relevant findings: (1) there is no “silver-bullet” tool that outperforms all other tools on every app, suggesting that it is difficult to build a single tool that adapts well to different apps with diverse UI designs; (2) a tool’s test effectiveness is not solely decided by its exploration algorithm, and the tool’s implementation also makes differences; (3) it is possible to enhance the design or the implementation of different tools using unified approaches. In the context of existing work’s focus on designing novel exploration algorithms, our findings suggest that it is worthwhile to develop complementary techniques that enhance existing tools to unleash the power of different exploration algorithms on various complex industrial apps. Inspired by the aforementioned findings, this dissertation presents three parts of research that explore the possibilities for existing automated UI test generation tools to be empowered with external automated support (i.e., techniques that are applicable to various tools while keeping them fully automatic). These parts of work enhance different components in the workflow of automated Android UI test generation tools. The first part (TOLLER) focuses on enhancing infrastructure support that enables a tool’s exploration algorithm to obtain states from and execute actions on the test device, allowing the tool to iterate faster and cover more App Under Test (AUT) functionalities within limited time. The second part (VET) focuses on providing exploration guidance for a tool on a specific AUT, based on our observation that a tool’s exploration algorithm or implementation might have applicability issues in certain conditions. The third part (EPIT) focuses on parallelization coordination for a tool and a specific AUT on multiple test devices to improve the overall test effectiveness or reduce testing costs by reducing overlapped explorations. Our evaluations show that the proposed techniques can help state-of-the-art automated Android UI test generation tools achieve substantially better test effectiveness or reduce testing costs on popular and complex industrial apps."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/115901"],"dc:language":["en","eng"],"dc:rights":["© 2022 Wenyu Wang"],"dc:subject":["UI testing","software testing","mobile app"],"dc:title":["Empowering automated mobile UI testing with external support"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:55Z"}