Optimizations to a massively parallel database and support of a shared scan architecture

This thesis presents a new architecture and optimizations to MapD, a database server which uses a hybrid of multi-CPU/multi-GPU architecture for query execution and analysis. We tackle the challenge of partitioning the data across multiple nodes with many CPUs and GPUs by means of an indexing framework. We implement a QuadTree spatial partitioning scheme and demonstrate how it improves the latencies of many queries when using the index as opposed to not using any. Moreover, we tackle the challenge of processing many queries (perhaps issued concurrently) where queries have very fast latency constraints, e.g, for visualization. We implement a software architecture which allows for scheduling concurrent client query requests to share processing of many queries in a single pass through the data ("shared scans"). Our experiments exhibit orders of magnitude improvement in query throughput for both, skewed and non-skewed workloads, for shared scans as opposed to serial execution.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2014

Author dc:creator

• Ahwal, Saher B

Advisor dc:contributor.advisor

• Samuel Madden.

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/91454

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/91454