Hardware acceleration of NetApp virtual tape library deduplication algorithm

In this thesis, I implemented an FPGA version of an algorithm used in the deduplication of backup storage data, to compare its performance to a software implementation of the algorithm. This algorithm flags sections of data with identifiers called "anchors". "Anchors" can be compared across versions of backup data, and if "anchors" are identical, sections of data are unchanged with high probability and might not have to be re-written to the backup disk. I also designed and implemented the environment by which this algorithm would communicate with a host computer. This environment can also easily be adapted for the acceleration of other shifting window algorithms. I tested the algorithm in simulation to verify its results as well as to estimate the speed at which the algorithm could process data.

Department dc:contributor.department

Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2008

Author dc:creator

• Wibowo, Amy Ancilla

Advisor dc:contributor.advisor

• Scott Westbrook and Christopher J. Terman.

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/46542

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/46542