Learning How Humans Play Board Games with GPT-4IAR

Planning and decision making are active areas of research in cognitive neuroscience that strive to explain how the brain makes decisions in complex scenarios. Research in this field has traditionally been restricted to simplistic experiments such as two-alternative forced choice situations, and has relatively recently broken into more naturalistic settings with the help of computational modeling and games. Importantly, these computational models aim to be interpretable, meaning that they are crafted in a way that what each parameter means has a clear meaning, perhaps in contrast to massive neural networks. However, the latter may better capture more complex behaviors that the hand-crafted model could miss, so it may be desirable to use a neural network as a guide or ``oracle'' to study and improve the parameters to include in the interpretable model. In this thesis, we present GPT-4IAR, a transformer neural network architecture for modeling and predicting human behavior in the board game four-in-a-row (4IAR). Building upon previous studies that use fully connected neural networks to improve models around 4IAR, and the excellent capabilities of the GPT architecture in tasks where data is sequential, we train a transformer on millions of games of 4IAR to study biases that arise in human decision making. Experiments show that conditioning action predictions on longer histories of previous moves leads to improved accuracy over prior state-of-the-art models, hinting at longer-term strategic biases in human gameplay. Reaction time prediction is also explored, showing promise in capturing meaningful gameplay statistics beyond raw actions.

Grantor dc:publisher

Helsingin yliopisto

Year dc:date.issued

2024

Author dc:creator

• Yeom Song, Victor Manuel

Contributors dc:contributor

• Helsingin yliopisto, Matemaattis-luonnontieteellinen tiedekunta
• University of Helsinki, Faculty of Science
• Helsingfors universitet, Matematisk-naturvetenskapliga fakulteten

• Generative Pre-Trained Transformers
• Human Decision Making
• Neural Networks

Language dc:language.iso

eng

Identifier URI

URN:NBN:fi:hulib-202406253314

OAI identifier oai:identifier

oai:helda.helsinki.fi:10138/577825