{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/120311"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/120311","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"A framework for programming and optimizing temporal graph neural networks","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","abstract_has_math":false,"creators":["Wang, Yufeng"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Mendis, Charith"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-05","date_published":"2023-05","updated_at":"2026-07-22T22:24:57Z","subjects":["Temporal Graph Neural Networks","Temporal Graphs","Dynamic Graphs","Redundancy-aware Optimizations","Memoization","Deduplication","Precomputation","Framework"],"languages":["en","eng"],"rights":["Copyright 2023 Yufeng Wang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/120311","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Mendis, Charith"]},{"key":"dc:creator","label":"Author","values":["Wang, Yufeng"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2023-05","2023-04-24"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Temporal Graph Neural Networks","Temporal Graphs","Dynamic Graphs","Redundancy-aware Optimizations","Memoization","Deduplication","Precomputation","Framework"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2023 Yufeng Wang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/120311"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","The student, Yufeng Wang, accepted the attached license on 2023-04-21 at 14:01.","The student, Yufeng Wang, submitted this Thesis for approval on 2023-04-21 at 14:10.","This Thesis was approved for publication on 2023-04-24 at 10:05.","DSpace SAF Submission Ingestion Package generated from Vireo submission #19097 on 2023-09-01 at 17:09:20","In recent years, Temporal Graph Neural Networks (TGNNs) have gained in popularity and adoption across application domains for learning predictive models on temporal graphs. Unlike earlier GNN models that assume a static graph, TGNNs are able to learn on evolving graph structure by employing time-encoding or memory-based techniques to capture the temporal patterns of the graph, attaining superior predictive performance than their static counterparts. Machine learning researchers are constantly experimenting with new designs for these TGNN models. There exists prior work on frameworks and optimizations for TGNNs, but they are restricted to discrete-time graphs that lack the richer temporal information of continuous-time graphs, and they do not exploit unique temporal characteristics. This leads to suboptimal model implementations, longer training time and inference latency, as well as difficult-to-use programming interfaces and non-composable abstractions. In this thesis, we address these issues by introducing our TGLite framework design. We outline a lightweight framework that provides easy-to-use abstractions and composable operators for programming and optimizing TGNNs for continuous-time temporal graphs. First, we present a set of redundancy-aware optimizations tailored to these TGNN models, which exploits unique characteristics in their temporal embedding and time-encoding computations. Next, we discuss how these optimizations, as well as other common TGNN computation patterns, are implemented as standard operators in the TGLite framework, along with details of the novel abstractions that they operate on. Our evaluation results indicate that our optimization techniques are effective for the TGAT model in accelerating inference performance, with geomean speedups of 4.88x on CPU and 2.93x on GPU. When generalizing these optimizations to other TGNN models as part of our TGLite framework, we show that TGLite can outperform strong baseline frameworks like TGL with geomean speedups of 1.86x for per-epoch training time and 1.84x for inference. As we continue the development of the TGLite prototype framework, we intend to improve current functionality and incorporate further optimizations while retaining the programmability and clean abstractions of the framework."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["A framework for programming and optimizing temporal graph neural networks"]}]}],"canonical_facts":{"dc:contributor":["Mendis, Charith"],"dc:creator":["Wang, Yufeng"],"dc:date":["2023-05","2023-04-24"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms","The student, Yufeng Wang, accepted the attached license on 2023-04-21 at 14:01.","The student, Yufeng Wang, submitted this Thesis for approval on 2023-04-21 at 14:10.","This Thesis was approved for publication on 2023-04-24 at 10:05.","DSpace SAF Submission Ingestion Package generated from Vireo submission #19097 on 2023-09-01 at 17:09:20","In recent years, Temporal Graph Neural Networks (TGNNs) have gained in popularity and adoption across application domains for learning predictive models on temporal graphs. Unlike earlier GNN models that assume a static graph, TGNNs are able to learn on evolving graph structure by employing time-encoding or memory-based techniques to capture the temporal patterns of the graph, attaining superior predictive performance than their static counterparts. Machine learning researchers are constantly experimenting with new designs for these TGNN models. There exists prior work on frameworks and optimizations for TGNNs, but they are restricted to discrete-time graphs that lack the richer temporal information of continuous-time graphs, and they do not exploit unique temporal characteristics. This leads to suboptimal model implementations, longer training time and inference latency, as well as difficult-to-use programming interfaces and non-composable abstractions. In this thesis, we address these issues by introducing our TGLite framework design. We outline a lightweight framework that provides easy-to-use abstractions and composable operators for programming and optimizing TGNNs for continuous-time temporal graphs. First, we present a set of redundancy-aware optimizations tailored to these TGNN models, which exploits unique characteristics in their temporal embedding and time-encoding computations. Next, we discuss how these optimizations, as well as other common TGNN computation patterns, are implemented as standard operators in the TGLite framework, along with details of the novel abstractions that they operate on. Our evaluation results indicate that our optimization techniques are effective for the TGAT model in accelerating inference performance, with geomean speedups of 4.88x on CPU and 2.93x on GPU. When generalizing these optimizations to other TGNN models as part of our TGLite framework, we show that TGLite can outperform strong baseline frameworks like TGL with geomean speedups of 1.86x for per-epoch training time and 1.84x for inference. As we continue the development of the TGLite prototype framework, we intend to improve current functionality and incorporate further optimizations while retaining the programmability and clean abstractions of the framework."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/120311"],"dc:language":["en","eng"],"dc:rights":["Copyright 2023 Yufeng Wang"],"dc:subject":["Temporal Graph Neural Networks","Temporal Graphs","Dynamic Graphs","Redundancy-aware Optimizations","Memoization","Deduplication","Precomputation","Framework"],"dc:title":["A framework for programming and optimizing temporal graph neural networks"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:57Z"}