{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/124697"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/124697","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Accelerating graph attention network inference on CPUs with layer fusion","abstract":"Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2026-05-01","abstract_html":"Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2026-05-01","abstract_has_math":false,"creators":["Yao, Yao"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Torrellas, Josep"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-05","date_published":"2024-05","updated_at":"2026-07-22T22:25:02Z","subjects":["Graph Attention Networks","Cpu","Layer Fusion"],"languages":["en","eng"],"rights":["Copyright 2024 Yao Yao"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/124697","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Torrellas, Josep"]},{"key":"dc:creator","label":"Author","values":["Yao, Yao"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-05","2024-04-29"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Graph Attention Networks","Cpu","Layer Fusion"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Yao Yao"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/124697"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2026-05-01","The student, Yao Yao, accepted the attached license on 2024-04-23 at 20:04.","The student, Yao Yao, submitted this Thesis for approval on 2024-04-23 at 20:20.","This Thesis was approved for publication on 2024-04-29 at 10:14.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20597 on 2024-09-16 at 00:50:21","Graphs are becoming a more and more popular data structure being used in many fields. Recently, Graph Attention Network (GAT), a special type of Graph Neural Network (GNN), has emerged as a powerful tool for processing graph-structured data, offering state-of-the-art performance for graph-related tasks like node classification. Existing works mostly focus on domain specific accelerators to optimize GAT inference. However, we believe that CPU is also an attractive choice for GAT inference because it is widely available and offers large memory capacity. Layer Fusion is a technique introduced in Graphite [35] that combines the memory-intensive aggregation and compute-intensive update phases in a GNN layer to overlap memory accesses with computation, thereby reducing memory stress when executing GNN workloads on CPUs. However, while this technique benefits general GNN models, it does not directly apply to GATs due to their additional attention calculation phase. We posit that this increased complexity in GAT presents a great opportunity for optimization using Layer Fusion techniques. By fusing the attention calculation and aggregation phases, we can overlap memory accesses with computation, thereby reducing DRAM traffic as well as execution time. Hence, this thesis work is motivated to explore how Layer Fusion can optimize GAT inference on CPUs. The thesis begins with an overview of the research context, providing a historical perspective on GAT evolution and the rationale for focusing on accelerating GAT inference on CPUs with Layer Fusion. It then explores the theoretical background of GATs and details their implementation in the DGL framework, serving as the baseline for comparison. Methodologies for incorporating Layer Fusion into GATs are discussed, including three variations that differ in the placement of the attention head iteration. Experimental results comparing the Layer Fusion approach against the DGL baseline show significant improvements in execution times across various datasets, with up to a 2.81x speedup. Sensitivity analyses explore the impact of factors like the number of attention heads and graph characteristics on performance, providing insights into the performance improvement achieved by the Layer Fusion approach."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Accelerating graph attention network inference on CPUs with layer fusion"]}]}],"canonical_facts":{"dc:contributor":["Torrellas, Josep"],"dc:creator":["Yao, Yao"],"dc:date":["2024-05","2024-04-29"],"dc:description":["Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2026-05-01","The student, Yao Yao, accepted the attached license on 2024-04-23 at 20:04.","The student, Yao Yao, submitted this Thesis for approval on 2024-04-23 at 20:20.","This Thesis was approved for publication on 2024-04-29 at 10:14.","DSpace SAF Submission Ingestion Package generated from Vireo submission #20597 on 2024-09-16 at 00:50:21","Graphs are becoming a more and more popular data structure being used in many fields. Recently, Graph Attention Network (GAT), a special type of Graph Neural Network (GNN), has emerged as a powerful tool for processing graph-structured data, offering state-of-the-art performance for graph-related tasks like node classification. Existing works mostly focus on domain specific accelerators to optimize GAT inference. However, we believe that CPU is also an attractive choice for GAT inference because it is widely available and offers large memory capacity. Layer Fusion is a technique introduced in Graphite [35] that combines the memory-intensive aggregation and compute-intensive update phases in a GNN layer to overlap memory accesses with computation, thereby reducing memory stress when executing GNN workloads on CPUs. However, while this technique benefits general GNN models, it does not directly apply to GATs due to their additional attention calculation phase. We posit that this increased complexity in GAT presents a great opportunity for optimization using Layer Fusion techniques. By fusing the attention calculation and aggregation phases, we can overlap memory accesses with computation, thereby reducing DRAM traffic as well as execution time. Hence, this thesis work is motivated to explore how Layer Fusion can optimize GAT inference on CPUs. The thesis begins with an overview of the research context, providing a historical perspective on GAT evolution and the rationale for focusing on accelerating GAT inference on CPUs with Layer Fusion. It then explores the theoretical background of GATs and details their implementation in the DGL framework, serving as the baseline for comparison. Methodologies for incorporating Layer Fusion into GATs are discussed, including three variations that differ in the placement of the attention head iteration. Experimental results comparing the Layer Fusion approach against the DGL baseline show significant improvements in execution times across various datasets, with up to a 2.81x speedup. Sensitivity analyses explore the impact of factors like the number of attention heads and graph characteristics on performance, providing insights into the performance improvement achieved by the Layer Fusion approach."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/124697"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Yao Yao"],"dc:subject":["Graph Attention Networks","Cpu","Layer Fusion"],"dc:title":["Accelerating graph attention network inference on CPUs with layer fusion"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:02Z"}