{"id":{"repo_id":"uts","oai_identifier":"oai:opus.lib.uts.edu.au:10453/154756"},"canonical_url":"https://search.dev.ndltd.org/etd/uts/oai:opus.lib.uts.edu.au:10453/154756","repository":{"repo_id":"uts","name":"University of Technology Sydney","base_url":"https://opus.lib.uts.edu.au/oai/request"},"display":{"title":"An Exploration of Spiking Neural Networks and their use on Reinforcement Learning Tasks","abstract":"Artificial neural networks have recently been the prominent architecture for reinforcement learning tasks. However, there is emerging evidence that spiking neural networks can perform just as well and can retain this performance across similar environments. Spiking neural networks are experiencing a surge in popularity due to their potential for large efficiency gains when compared to their traditional artificial neural network counterparts. Though, when attempting to replicate the successes of artificial neural networks, challenges are faced due to their vastly different architectures and therefore differing methods for training and optimisation. As spiking neural networks are considered more biologically plausible, methods of training inspired by natural learning have been proposed. These methods have been minimally applied to complex reinforcement learning domains, instead typically focusing on supervised learning problems. This thesis aims to explore the use of spiking neural networks in reinforcement learning domains. Methods of evolutionary and spike timing based training will be explored. Additionally, an in-depth analysis of different encoding and decoding methods is conducted. This research also addresses the trends in the effect of the time period that a state is exposed to a spiking neural network on the performance of the networks.","abstract_html":"Artificial neural networks have recently been the prominent architecture for reinforcement learning tasks. However, there is emerging evidence that spiking neural networks can perform just as well and can retain this performance across similar environments. Spiking neural networks are experiencing a surge in popularity due to their potential for large efficiency gains when compared to their traditional artificial neural network counterparts. Though, when attempting to replicate the successes of artificial neural networks, challenges are faced due to their vastly different architectures and therefore differing methods for training and optimisation. As spiking neural networks are considered more biologically plausible, methods of training inspired by natural learning have been proposed. These methods have been minimally applied to complex reinforcement learning domains, instead typically focusing on supervised learning problems. This thesis aims to explore the use of spiking neural networks in reinforcement learning domains. Methods of evolutionary and spike timing based training will be explored. Additionally, an in-depth analysis of different encoding and decoding methods is conducted. This research also addresses the trends in the effect of the time period that a state is exposed to a spiking neural network on the performance of the networks.","abstract_has_math":false,"creators":["Rafe, Andrew William"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021","date_published":"2021","updated_at":"2026-07-24T06:32:04Z","subjects":[],"languages":["en_US"],"rights":["The author owns the copyright in this thesis including all reproduction and reuse rights for the work. The work may not be altered without the permission of the copyright owner. Attribution is essential when quoting or paraphrasing from this thesis.","au.edu.uts.lib/ppc","info:eu-repo/semantics/openAccess"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/10453/154756","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Rafe, Andrew William"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2022-02-22T01:19:23Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2022-02-22T01:19:23Z"]},{"key":"dc:date.issued","label":"Date","values":["2021"]},{"key":"dc:relation","label":"Dc Relation","values":["https://opus.lib.uts.edu.au/bitstream/10453/154756/2/02whole.pdf"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]},{"key":"dc:rights","label":"Dc Rights","values":["The author owns the copyright in this thesis including all reproduction and reuse rights for the work. The work may not be altered without the permission of the copyright owner. Attribution is essential when quoting or paraphrasing from this thesis.","au.edu.uts.lib/ppc","info:eu-repo/semantics/openAccess"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/10453/154756"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["University of Technology Sydney. Faculty of Engineering and Information Technology."]},{"key":"dc:description.abstract","label":"Abstract","values":["Artificial neural networks have recently been the prominent architecture for reinforcement learning tasks. However, there is emerging evidence that spiking neural networks can perform just as well and can retain this performance across similar environments. Spiking neural networks are experiencing a surge in popularity due to their potential for large efficiency gains when compared to their traditional artificial neural network counterparts. Though, when attempting to replicate the successes of artificial neural networks, challenges are faced due to their vastly different architectures and therefore differing methods for training and optimisation. As spiking neural networks are considered more biologically plausible, methods of training inspired by natural learning have been proposed. These methods have been minimally applied to complex reinforcement learning domains, instead typically focusing on supervised learning problems. This thesis aims to explore the use of spiking neural networks in reinforcement learning domains. Methods of evolutionary and spike timing based training will be explored. Additionally, an in-depth analysis of different encoding and decoding methods is conducted. This research also addresses the trends in the effect of the time period that a state is exposed to a spiking neural network on the performance of the networks."]},{"key":"dc:format","label":"Dc Format","values":["Thesis (MSc(CompSc))"]},{"key":"dc:title","label":"Title","values":["An Exploration of Spiking Neural Networks and their use on Reinforcement Learning Tasks"]}]}],"canonical_facts":{"dc:creator":["Rafe, Andrew William"],"dc:date.accessioned":["2022-02-22T01:19:23Z"],"dc:date.available":["2022-02-22T01:19:23Z"],"dc:date.issued":["2021"],"dc:description":["University of Technology Sydney. Faculty of Engineering and Information Technology."],"dc:description.abstract":["Artificial neural networks have recently been the prominent architecture for reinforcement learning tasks. However, there is emerging evidence that spiking neural networks can perform just as well and can retain this performance across similar environments. Spiking neural networks are experiencing a surge in popularity due to their potential for large efficiency gains when compared to their traditional artificial neural network counterparts. Though, when attempting to replicate the successes of artificial neural networks, challenges are faced due to their vastly different architectures and therefore differing methods for training and optimisation. As spiking neural networks are considered more biologically plausible, methods of training inspired by natural learning have been proposed. These methods have been minimally applied to complex reinforcement learning domains, instead typically focusing on supervised learning problems. This thesis aims to explore the use of spiking neural networks in reinforcement learning domains. Methods of evolutionary and spike timing based training will be explored. Additionally, an in-depth analysis of different encoding and decoding methods is conducted. This research also addresses the trends in the effect of the time period that a state is exposed to a spiking neural network on the performance of the networks."],"dc:format":["Thesis (MSc(CompSc))"],"dc:identifier.uri":["http://hdl.handle.net/10453/154756"],"dc:language.iso":["en_US"],"dc:relation":["https://opus.lib.uts.edu.au/bitstream/10453/154756/2/02whole.pdf"],"dc:rights":["The author owns the copyright in this thesis including all reproduction and reuse rights for the work. The work may not be altered without the permission of the copyright owner. Attribution is essential when quoting or paraphrasing from this thesis.","au.edu.uts.lib/ppc","info:eu-repo/semantics/openAccess"],"dc:title":["An Exploration of Spiking Neural Networks and their use on Reinforcement Learning Tasks"],"dc:type":["Thesis"]},"updated_at":"2026-07-24T06:32:04Z"}