{"id":{"repo_id":"uwo","oai_identifier":"oai:uwo.scholaris.ca:20.500.14721/29542"},"canonical_url":"https://search.dev.ndltd.org/etd/uwo/oai:uwo.scholaris.ca:20.500.14721/29542","repository":{"repo_id":"uwo","name":"Western University","base_url":"https://uwo.scholaris.ca/server/oai/request"},"display":{"title":"Forecasting Energy Consumption using Sequence to Sequence Attention models","abstract":"To combat negative environmental conditions, reduce operating costs, and identify energy savings opportunities, it is essential to efficiently manage energy consumption. Internet of Things (IoT) devices, including widely-used smart meters, have created possibilities for sensor based energy forecasting. Machine learning algorithms commonly used for energy forecasting, such as FeedForward Neural Networks, are not well-suited for interpreting the time dimensionality of a signal. Consequently, this thesis applies Sequence-to-Sequence (S2S) Recurrent Neural Networks (RNNs) with attention for electrical load forecasting. The S2S and S2S attention architectures commonly used for neural machine translation are adapted for energy forecasting. An RNN enables capturing time dependencies present in the load data, while the S2S RNN model strengthens consecutive sequence prediction by combining two RNNs: encoder and decoder. Adding the attention mechanism to these S2S RNNs alleviates the burden of connecting the encoder and decoder. Presented experiments compare a regular S2S model and four S2S attention models with two baseline models, the conventional Non-S2S RNN and a Deep Neural Network (DNN). Furthermore, each RNN model was evaluated with three different RNN-cells: Vanilla RNN, Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM) cell. All models were trained and tested on one building-level electrical load dataset, with five-minute incremental data. Results showed that the S2S Bahdanau et al. attention model was the dominant model as it outperformed all other models for nearly all forecasting lengths.","abstract_html":"To combat negative environmental conditions, reduce operating costs, and identify energy savings opportunities, it is essential to efficiently manage energy consumption. Internet of Things (IoT) devices, including widely-used smart meters, have created possibilities for sensor based energy forecasting. Machine learning algorithms commonly used for energy forecasting, such as FeedForward Neural Networks, are not well-suited for interpreting the time dimensionality of a signal. Consequently, this thesis applies Sequence-to-Sequence (S2S) Recurrent Neural Networks (RNNs) with attention for electrical load forecasting. The S2S and S2S attention architectures commonly used for neural machine translation are adapted for energy forecasting. An RNN enables capturing time dependencies present in the load data, while the S2S RNN model strengthens consecutive sequence prediction by combining two RNNs: encoder and decoder. Adding the attention mechanism to these S2S RNNs alleviates the burden of connecting the encoder and decoder. Presented experiments compare a regular S2S model and four S2S attention models with two baseline models, the conventional Non-S2S RNN and a Deep Neural Network (DNN). Furthermore, each RNN model was evaluated with three different RNN-cells: Vanilla RNN, Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM) cell. All models were trained and tested on one building-level electrical load dataset, with five-minute incremental data. Results showed that the S2S Bahdanau et al. attention model was the dominant model as it outperformed all other models for nearly all forecasting lengths.","abstract_has_math":false,"creators":["Sehovac, Ljubisa"],"institution":"The University of Western Ontario","degree_name":"M Eng Sci","degree_level":null,"degree_discipline":"Electrical and Computer Engineering","degree_department":null,"school":null,"contributors":[],"advisors":["Grolinger, Katarina"],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019-08-23","date_published":"2019-08-23","updated_at":"2026-07-27T21:55:56Z","subjects":["Deep Learning","Energy Load Forecasting","Recurrent Neural Networks","Sequence-to-Sequence","Attention"],"languages":["en_ca"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/20.500.14721/29542","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Grolinger, Katarina"]},{"key":"dc:creator","label":"Author","values":["Sehovac, Ljubisa"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-07-10T18:32:20Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-07-10T18:32:20Z"]},{"key":"dc:date.issued","label":"Date","values":["2019-08-23"]},{"key":"dc:publisher","label":"Institution","values":["The University of Western Ontario"]},{"key":"dc:type","label":"Dc Type","values":["thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical and Computer Engineering"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M Eng Sci"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Deep Learning","Energy Load Forecasting","Recurrent Neural Networks","Sequence-to-Sequence","Attention"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_ca"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/20.500.14721/29542"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Collaborative Specialization: Artificial Intelligence","The thesis cover page in the PDF document includes references to Western University’s previous institutional repository platform, known as Scholarship@Western, and links to that platform (beginning with ir.lib.uwo.ca). In citing or referring to this thesis, use the DOI or handle from this page instead. Sample citation: Author name, \"Thesis title.\" (Year). Western University Open Repository. https://doi.org/10.71858/123456."]},{"key":"dc:description.abstract","label":"Abstract","values":["To combat negative environmental conditions, reduce operating costs, and identify energy savings opportunities, it is essential to efficiently manage energy consumption. Internet of Things (IoT) devices, including widely-used smart meters, have created possibilities for sensor based energy forecasting. Machine learning algorithms commonly used for energy forecasting, such as FeedForward Neural Networks, are not well-suited for interpreting the time dimensionality of a signal. Consequently, this thesis applies Sequence-to-Sequence (S2S) Recurrent Neural Networks (RNNs) with attention for electrical load forecasting. The S2S and S2S attention architectures commonly used for neural machine translation are adapted for energy forecasting. An RNN enables capturing time dependencies present in the load data, while the S2S RNN model strengthens consecutive sequence prediction by combining two RNNs: encoder and decoder. Adding the attention mechanism to these S2S RNNs alleviates the burden of connecting the encoder and decoder. Presented experiments compare a regular S2S model and four S2S attention models with two baseline models, the conventional Non-S2S RNN and a Deep Neural Network (DNN). Furthermore, each RNN model was evaluated with three different RNN-cells: Vanilla RNN, Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM) cell. All models were trained and tested on one building-level electrical load dataset, with five-minute incremental data. Results showed that the S2S Bahdanau et al. attention model was the dominant model as it outperformed all other models for nearly all forecasting lengths."]},{"key":"dc:title","label":"Title","values":["Forecasting Energy Consumption using Sequence to Sequence Attention models"]}]}],"canonical_facts":{"dc:contributor.advisor":["Grolinger, Katarina"],"dc:creator":["Sehovac, Ljubisa"],"dc:date.accessioned":["2025-07-10T18:32:20Z"],"dc:date.available":["2025-07-10T18:32:20Z"],"dc:date.issued":["2019-08-23"],"dc:description":["Collaborative Specialization: Artificial Intelligence","The thesis cover page in the PDF document includes references to Western University’s previous institutional repository platform, known as Scholarship@Western, and links to that platform (beginning with ir.lib.uwo.ca). In citing or referring to this thesis, use the DOI or handle from this page instead. Sample citation: Author name, \"Thesis title.\" (Year). Western University Open Repository. https://doi.org/10.71858/123456."],"dc:description.abstract":["To combat negative environmental conditions, reduce operating costs, and identify energy savings opportunities, it is essential to efficiently manage energy consumption. Internet of Things (IoT) devices, including widely-used smart meters, have created possibilities for sensor based energy forecasting. Machine learning algorithms commonly used for energy forecasting, such as FeedForward Neural Networks, are not well-suited for interpreting the time dimensionality of a signal. Consequently, this thesis applies Sequence-to-Sequence (S2S) Recurrent Neural Networks (RNNs) with attention for electrical load forecasting. The S2S and S2S attention architectures commonly used for neural machine translation are adapted for energy forecasting. An RNN enables capturing time dependencies present in the load data, while the S2S RNN model strengthens consecutive sequence prediction by combining two RNNs: encoder and decoder. Adding the attention mechanism to these S2S RNNs alleviates the burden of connecting the encoder and decoder. Presented experiments compare a regular S2S model and four S2S attention models with two baseline models, the conventional Non-S2S RNN and a Deep Neural Network (DNN). Furthermore, each RNN model was evaluated with three different RNN-cells: Vanilla RNN, Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM) cell. All models were trained and tested on one building-level electrical load dataset, with five-minute incremental data. Results showed that the S2S Bahdanau et al. attention model was the dominant model as it outperformed all other models for nearly all forecasting lengths."],"dc:identifier.uri":["https://hdl.handle.net/20.500.14721/29542"],"dc:language.iso":["en_ca"],"dc:publisher":["The University of Western Ontario"],"dc:subject":["Deep Learning","Energy Load Forecasting","Recurrent Neural Networks","Sequence-to-Sequence","Attention"],"dc:title":["Forecasting Energy Consumption using Sequence to Sequence Attention models"],"dc:type":["thesis"],"thesis:degree_discipline":["Electrical and Computer Engineering"],"thesis:degree_name":["M Eng Sci"]},"updated_at":"2026-07-27T21:55:56Z"}