{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/129588"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/129588","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Performance evaluation of a Ray-based MPI runtime for hybrid HPC-cloud systems","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","abstract_has_math":false,"creators":["Song, Yifei"],"institution":"University of Illinois Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Kindratenko, Volodymyr"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-04-28","date_published":"2025-04-28","updated_at":"2026-07-22T22:25:05Z","subjects":["Ray","MPI","HPC"],"languages":["en","eng"],"rights":["Copyright 2025 Yifei Song"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/129588","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Kindratenko, Volodymyr"]},{"key":"dc:creator","label":"Author","values":["Song, Yifei"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-04-28","2025-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Ray","MPI","HPC"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Yifei Song"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/129588"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","The student, Yifei Song, accepted the attached license on 2025-04-26 at 16:07.","The student, Yifei Song, submitted this Thesis for approval on 2025-04-26 at 16:35.","This Thesis was approved for publication on 2025-04-28 at 16:16.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22010 on 2025-10-19 at 19:16:22","In this work, I present two contributions to the development and benchmarking of the Ray Collective Communication Library (CCL) and its integration with MPI workflows. First, I implemented examples demonstrating the adaptation of mpi4py code to Ray CCL backend. This includes translation and validation of critical mpi4py test cases, specifically focusing on fundamental operations such as send, receive, broadcast, and MPI Group functionalities. I demonstrated that the translated code produces identical outputs to the original mpi4py tests, ensuring reliability and correctness. The adaptation of mpi4py code to Ray CCL backend enables the migration of existing MPI applications to HPC cloud environments where mpi4py may not be suitable. By mapping MPI communication semantics to Ray CCL, we are able to fully leverage Ray’s advantages, including elastic scheduling, fault tolerance, resource-aware execution, and cloud-native support, making it possible to run traditionally MPI-bound HPC applications more effectively on the modern cloud infrastructure. Second, I designed and implemented a comprehensive benchmarking suite to evaluate the performance of the Ray-based MPI communication backend in comparison with mpi4py. This benchmarking framework provides valuable insights into the relative performance characteristics of both communication paradigms, particularly in hybrid HPC-Cloud scenarios where traditional MPI backends may face challenges. Through my validation work and comprehensive benchmarking analysis, I helped evaluate the feasibility of bridging traditional HPC communication patterns with cloud-native distributed computing frameworks. My testing contributions support the broader goal of enabling workload migration across diverse computing platforms."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Performance evaluation of a Ray-based MPI runtime for hybrid HPC-cloud systems"]}]}],"canonical_facts":{"dc:contributor":["Kindratenko, Volodymyr"],"dc:creator":["Song, Yifei"],"dc:date":["2025-04-28","2025-05"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2027-05-01","The student, Yifei Song, accepted the attached license on 2025-04-26 at 16:07.","The student, Yifei Song, submitted this Thesis for approval on 2025-04-26 at 16:35.","This Thesis was approved for publication on 2025-04-28 at 16:16.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22010 on 2025-10-19 at 19:16:22","In this work, I present two contributions to the development and benchmarking of the Ray Collective Communication Library (CCL) and its integration with MPI workflows. First, I implemented examples demonstrating the adaptation of mpi4py code to Ray CCL backend. This includes translation and validation of critical mpi4py test cases, specifically focusing on fundamental operations such as send, receive, broadcast, and MPI Group functionalities. I demonstrated that the translated code produces identical outputs to the original mpi4py tests, ensuring reliability and correctness. The adaptation of mpi4py code to Ray CCL backend enables the migration of existing MPI applications to HPC cloud environments where mpi4py may not be suitable. By mapping MPI communication semantics to Ray CCL, we are able to fully leverage Ray’s advantages, including elastic scheduling, fault tolerance, resource-aware execution, and cloud-native support, making it possible to run traditionally MPI-bound HPC applications more effectively on the modern cloud infrastructure. Second, I designed and implemented a comprehensive benchmarking suite to evaluate the performance of the Ray-based MPI communication backend in comparison with mpi4py. This benchmarking framework provides valuable insights into the relative performance characteristics of both communication paradigms, particularly in hybrid HPC-Cloud scenarios where traditional MPI backends may face challenges. Through my validation work and comprehensive benchmarking analysis, I helped evaluate the feasibility of bridging traditional HPC communication patterns with cloud-native distributed computing frameworks. My testing contributions support the broader goal of enabling workload migration across diverse computing platforms."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/129588"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Yifei Song"],"dc:subject":["Ray","MPI","HPC"],"dc:title":["Performance evaluation of a Ray-based MPI runtime for hybrid HPC-cloud systems"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:05Z"}