Engineering and evaluating bulk data transfer planning over wide area networks

Users of cloud computing services are faced with the problem of planning and transferring large amounts of data across a geographically dispersed network under time and budget constraints. Pandora is the first service to solve the planning problem but underneath it has a set of issues, which are addressed in this work. This thesis enhances Pandora by improving its interface, scalability, modularity, and extensibility. This is done by evaluating the performance of various GPU linear program solvers on Pandora’s workloads, and by designing and implementing two new systems: a modular C++ framework called Pandora’s Toolbox that solves the bulk data transfer problem, and a web service for planning bulk data transfers. Pandora’s Toolbox models the steps of the bulk data transfer problem and has an extensible design that allows various linear program solvers (e.g., GLPK and GPU solvers) to integrate into it. The web service effectively allows users to construct a shipping network and plan bulk data transfers over it through both a web and a RESTful interface.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2011

Author dc:creator

• Krueger, Simon P.

Contributors dc:contributor

• Gupta, Indranil

• Pandora
• Bulk Data Transfer Planning
• Linear Programing
• graphic processor unit (GPU)
• Web Service
• Representational State Transfer (REST)
• C++ Framework
• Shipping Networks
• Cloud Computing

Statement dc:rights

• Copyright 2011 Simon Krueger

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/24184

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/24184