Aiding the experts: how artificial intelligence can augment expert evaluation with PathOS+

Within games user research (GUR) predictive methods like expert evaluation are good for getting easy insights on a game in development but may not accurately reflect the player experience. On the other hand, experimental methods like playtesting can accurately capture the player experience but are time consuming and resource intensive. AI agents have been able to mitigate the issues of playtesting, and the data generated from these agents can supplement expert evaluation. To that end we introduce PathOS+. This tool allows the simulations of agents and has features that allows users to conduct their evaluations in the same place as the game, and then export their findings. We ran a study to evaluate how PathOS+ fares as an expert evaluation tool with participants of varying levels of UR experience. The results show that it is viable to use AI to identify design problems and offer more validity to expert evaluation.

Name thesis:degree_name

Master of Science (MSc)

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Ontario Institute of Technology

Year dc:date.issued

2022

Author dc:creator

• Nova, Atiya Nowshin

Advisor dc:contributor.advisor

• Mirza-Babaei, Pejman

• Expert evaluation
• Playtesting
• Artificial Intelligence
• Games user research
• Video games

Language dc:language.iso

en

Handle dc:identifier.uri

https://hdl.handle.net/10155/1516

OAI identifier oai:identifier

oai:ontariotechu.scholaris.ca:10155/1516