Software topological message aggregation techniques for large-scale parallel systems

High overhead of fine-grained communication is a significant performance bottleneck for many classes of applications written for large scale parallel systems. This thesis explores techniques for reducing this overhead through topological aggregation, in which fine-grained messages are dynamically combined not just at each source of communication, but also at intermediate points between source and destination processors. The performance characteristics of aggregation and selection of virtual topology for routing are analyzed theoretically and experimentally. Schemes that exploit fast intra-node communication to reduce the number of inter-node messages are also explored. The presented techniques are implemented for the Charm++ parallel programming system in the Topological Routing and Aggregation Module (TRAM). It is also demonstrated how TRAM can be automated at the level of the runtime system to function with little or no configuration or input required from the user. Using TRAM, the performance of a number of benchmark and scientific applications is evaluated, with speedups of up to 10x for communication benchmarks and up to 4x for full-fledged scientific applications on petascale systems.

Name thesis:degree_name

Ph.D.

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2015

Author dc:creator

• Wesolowski, Lukasz

Contributors dc:contributor

• Kale, Laxmikant V.
• Gropp, William D.
• Torrellas, Josep
• Balaji, Pavan

• Communication Optimization
• Message Aggregation

Statement dc:rights

• Copyright 2014 Lukasz Wesolowski

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/72761

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/72761