Exploring the impact of novelty and objective-directed evolution in company with MAP-Elites and HyperNEAT

Collective robotics refers to the field of robotics that focuses on the coordination and collaboration of multiple agents to perform a task or solve a problem. The ability to automatically design controllers for such agents in a collective system is an attractive proposition. In this thesis we investigate the impact on performance of combining MAP-Elites with HyperNEAT while varying the evolutionary search directive between an objective and non-objective search, and a hybrid approach. Objective search refers to evolutionary algorithms that explicitly optimize a predetermined performance metric, whereas nonobjective search refers to evolutionary approaches that primarily focuses on exploration and diversity within the search space. HyperNEAT is an evolutionary method that makes use of indirect encoding to evolve agents. Whereas in typical evolutionary methods, only the fittest agents survive to future generations, the inclusion of MAP-Elites allows not only the fittest agents but also those that demonstrate unique behaviour to survive (the elites). MAP-Elites is referred to as an illumination algorithm because by retaining these elite agents in the population, we expect to increase the chances of exploring and thus illuminating novel, yet potentially high-performing regions of the search space. To evaluate these methods, we use Keep-away, a simulated collective robotics task within the RoboCup football framework as a case study. In Keep-away, a team of "keeper" robots attempt to maintain possession of the football while opposing "taker" robots try to intercept it. For this study, we produced controllers for the keeper agents. This research report sheds light on how the combination of these methods affects the agents' performance and their ability explore the behaviour search space. The insights gained from this study will be valuable for researchers working to understand the value and applicability of combining illumination algorithms such as MAP-Elites with objective and non-objective search for gaining performance in Keep-away and similar tasks.

Grantor dc:publisher.institution

Department of Computer Science

Year dc:date.issued

2025

Author dc:creator

• Breytenbach, Jeremy

Advisor dc:contributor.advisor

• Nitschke, Geoff Stuart

• Computer Science

Handle dc:identifier.uri

http://hdl.handle.net/11427/41491

OAI identifier oai:identifier

oai:open.uct.ac.za:11427/41491