Enhancing HPC on Virtual Systems in Clouds through Optimizing Virtual Overlay Networks

Virtual Ethernet overlay provides a powerful model for realizing virtual distributed and parallel computing systems with strong isolation, portability, and recoverability properties. However, in extremely high throughput and low latency networks, such overlays can suffer from bandwidth and latency limitations, which is of particular concern in HPC environments. Through a careful and quantitative analysis, I iden- tify three core issues limiting performance: delayed and excessive virtual interrupt delivery into guests, copies between host and guest data buffers during encapsulation, and the semantic gap between virtual Ethernet features and underlying physical network features. I propose three novel optimizations in response: optimistic timer- free virtual interrupt injection, zero-copy cut-through data forwarding, and virtual TCP offload. These optimizations improve the latency and bandwidth of the overlay network on 10 Gbps Ethernet and InfiniBand interconnects, resulting in near-native performance for a wide range of microbenchmarks and MPI application benchmarks.

Name thesis:degree_name

Computer Science

Level thesis:degree_level

Dissertation

Discipline thesis:degree_discipline

Department of Computer Science

Year

2013

Author dc:creator

• Cui, Zheng

Contributors dc:contributor

• Bridges, Patrick G.
• Arnold, Dorian
• Crandall, Jedidiah R.
• Dinda, Peter A.
• Ghani, Nasir

• Virtualization
• Virtual Networking
• Networking
• High Performance Computing
• Performance Optimization
• InfiniBand
• 10 Gbps Ethernet

Language dc:language

English

Identifier

https://digitalrepository.unm.edu/cs_etds/27

OAI identifier oai:identifier

oai:digitalrepository.unm.edu:cs_etds-1026