An Investigation into Machine Learning Techniques for Designing Dynamic Difficulty Agents in Real-Time Games

<p>Video games are an incredibly popular pastime enjoyed by people of all ages world wide. Many different kinds of games exist, but most games feature some elements of the player overcoming some challenge, usually through gameplay. These challenges are insurmountable for some people and may turn them off to video games as a pastime. Games can be made more accessible to players of little skill and/or experience through the use of Dynamic Difficulty Adjustment (DDA) systems that adjust the difficulty of the game in response to the player’s performance. This research seeks to establish the effectiveness of machine learning techniques for use in developing DDA systems in real-time games for the purpose of making games more accessible and therefore more popular.</p> <p>A first-person platforming game where the player dodges attacks from AI-controlled turrets was created to gauge player’s perceptions of difficulty and measure how much their perceptions could be changed through the use of machine-learning backed DDA systems. Twenty players played through four similar game environments, some with DDA systems present and some without, and answered survey questions about their perception of the games’ difficulty between each game.</p> <p>While the players had varying levels of skill and experience with video games, all players showed a decrease in perception of difficulty and an increase in performance in the game environments where DDA systems were present. Additionally, cost benefit is demonstrated. The workflows used in developing the experimental game and the DDA systems within were found to be feasible in terms of the added development burden required, as compared to the quality of the results produced.</p> <p>These findings support the suitability of machine learning techniques, specifically reinforcement-learning-trained neural networks (RLNN), in the development of effective DDA systems. Consequently, this research serves as a baseline which justifies the use and development of machine-learning-controlled DDA systems in video games and videogame- adjacent applications.</p>

Name thesis:degree_name

M.S.

Level thesis:degree_level

Masters Thesis

Year

2023

Author dc:creator

• Dunagan, Ryan Adare

Contributors dc:contributor

• Chris J. GauthierDickey
• Kerstin Haring
• Stephen Hutt

• Constraint satisfaction
• Dynamic difficulty adjustment (DDA)
• Game development
• Machine learning
• Reinforcement learning
• Video games
• Artificial Intelligence and Robotics
• Computer Sciences
• Graphics and Human Computer Interfaces
• Other Computer Sciences
• Physical Sciences and Mathematics

Statement dc:rights

• <p>Copyright is held by the author. User is responsible for all copyright compliance.</p>

Language dc:language

English (eng)

Repository record dc:identifier

https://digitalcommons.du.edu/etd/2275

OAI identifier oai:identifier

oai:digitalcommons.du.edu:etd-3264