{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/44414"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/44414","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Auto-tuned optimized parallel I/O for GIScience and spatial applications","abstract":"Reading and writing big data is increasingly becoming a major bottleneck of using high-performance computing systems as we are heading towards the Exascale era. An unprecedented amount of data is being produced everyday by different sources. On the other hand, the computation power of HPC systems is getting scaled to hundreds of thousands cores. However, for an application to be able to utilize this much data and computation power, using I/O effectively is a must. One of the fields dealing with huge amount of data is geographic information science. In this thesis, we have implemented a parallel I/O library specialized for spatial data analysis in GIScience, capable of treating different I/O patterns such as Row-Wise, Column-Wise and Block-Wise I/O. We then establish an auto-tuning framework for finding optimal parallel I/O configurations. This auto-tuning framework is based on genetic algorithm and works on a range of configurations from the parallel file system all the way up to spatial data-analysis applications. The results and findings of a set of I/O intensive experiments executed on large HPC systems are also presented to demonstrate the effectiveness of the framework.","abstract_html":"Reading and writing big data is increasingly becoming a major bottleneck of using high-performance computing systems as we are heading towards the Exascale era. An unprecedented amount of data is being produced everyday by different sources. On the other hand, the computation power of HPC systems is getting scaled to hundreds of thousands cores. However, for an application to be able to utilize this much data and computation power, using I/O effectively is a must. One of the fields dealing with huge amount of data is geographic information science. In this thesis, we have implemented a parallel I/O library specialized for spatial data analysis in GIScience, capable of treating different I/O patterns such as Row-Wise, Column-Wise and Block-Wise I/O. We then establish an auto-tuning framework for finding optimal parallel I/O configurations. This auto-tuning framework is based on genetic algorithm and works on a range of configurations from the parallel file system all the way up to spatial data-analysis applications. The results and findings of a set of I/O intensive experiments executed on large HPC systems are also presented to demonstrate the effectiveness of the framework.","abstract_has_math":false,"creators":["Behzad, Babak"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Snir, Marc","Wang, Shaowen"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2013,"date_issued":"2013-05-24T22:15:18Z","date_published":"2013-05-24T22:15:18Z","updated_at":"2026-07-22T22:25:34Z","subjects":["Parallel I/O","GIScience","High Performance Computing (HPC)","Spatial Applications","Auto-Tuning"],"languages":["en"],"rights":["Copyright 2013 Babak Behzad"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/44414","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Snir, Marc","Wang, Shaowen"]},{"key":"dc:creator","label":"Author","values":["Behzad, Babak"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2013-05-24T22:15:18Z","2015-05-24T10:01:23Z","2013-05"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Parallel I/O","GIScience","High Performance Computing (HPC)","Spatial Applications","Auto-Tuning"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2013 Babak Behzad"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/44414"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Reading and writing big data is increasingly becoming a major bottleneck of using high-performance computing systems as we are heading towards the Exascale era. An unprecedented amount of data is being produced everyday by different sources. On the other hand, the computation power of HPC systems is getting scaled to hundreds of thousands cores. However, for an application to be able to utilize this much data and computation power, using I/O effectively is a must. One of the fields dealing with huge amount of data is geographic information science. In this thesis, we have implemented a parallel I/O library specialized for spatial data analysis in GIScience, capable of treating different I/O patterns such as Row-Wise, Column-Wise and Block-Wise I/O. We then establish an auto-tuning framework for finding optimal parallel I/O configurations. This auto-tuning framework is based on genetic algorithm and works on a range of configurations from the parallel file system all the way up to spatial data-analysis applications. The results and findings of a set of I/O intensive experiments executed on large HPC systems are also presented to demonstrate the effectiveness of the framework.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2013-04-22T18:10:42Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Behzad_Babak.pdf: 980892 bytes, checksum: bd69cf9666973f6cf0c0c0cb3003c952 (MD5)","Made available in DSpace on 2013-05-24T22:15:18Z (GMT). No. of bitstreams: 2 Babak_Behzad.pdf: 980892 bytes, checksum: bd69cf9666973f6cf0c0c0cb3003c952 (MD5) license.txt: 4061 bytes, checksum: fa3c827969ff68c5a2ca597a38d56984 (MD5)","Restriction data tranferred 2014-07-01T11:35:39-05:00 Original Data Group with Access UIUC Users [automated] Release Date: 2015-05-24 17:18:31 UTC Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Seth Robbins (srobbins@illinois.edu) on 2013-05-24T22:18:40Z Item is restricted until 2015-05-24T22:18:31Z","U of I Only Restriction Lifted for Item 44387 on 2015-05-24T10:01:23Z."]},{"key":"dc:title","label":"Title","values":["Auto-tuned optimized parallel I/O for GIScience and spatial applications"]}]}],"canonical_facts":{"dc:contributor":["Snir, Marc","Wang, Shaowen"],"dc:creator":["Behzad, Babak"],"dc:date":["2013-05-24T22:15:18Z","2015-05-24T10:01:23Z","2013-05"],"dc:description":["Reading and writing big data is increasingly becoming a major bottleneck of using high-performance computing systems as we are heading towards the Exascale era. An unprecedented amount of data is being produced everyday by different sources. On the other hand, the computation power of HPC systems is getting scaled to hundreds of thousands cores. However, for an application to be able to utilize this much data and computation power, using I/O effectively is a must. One of the fields dealing with huge amount of data is geographic information science. In this thesis, we have implemented a parallel I/O library specialized for spatial data analysis in GIScience, capable of treating different I/O patterns such as Row-Wise, Column-Wise and Block-Wise I/O. We then establish an auto-tuning framework for finding optimal parallel I/O configurations. This auto-tuning framework is based on genetic algorithm and works on a range of configurations from the parallel file system all the way up to spatial data-analysis applications. The results and findings of a set of I/O intensive experiments executed on large HPC systems are also presented to demonstrate the effectiveness of the framework.","Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2013-04-22T18:10:42Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Behzad_Babak.pdf: 980892 bytes, checksum: bd69cf9666973f6cf0c0c0cb3003c952 (MD5)","Made available in DSpace on 2013-05-24T22:15:18Z (GMT). No. of bitstreams: 2 Babak_Behzad.pdf: 980892 bytes, checksum: bd69cf9666973f6cf0c0c0cb3003c952 (MD5) license.txt: 4061 bytes, checksum: fa3c827969ff68c5a2ca597a38d56984 (MD5)","Restriction data tranferred 2014-07-01T11:35:39-05:00 Original Data Group with Access UIUC Users [automated] Release Date: 2015-05-24 17:18:31 UTC Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Item marked as restricted to the 'UIUC Users [automated]' Group (id=2) by Seth Robbins (srobbins@illinois.edu) on 2013-05-24T22:18:40Z Item is restricted until 2015-05-24T22:18:31Z","U of I Only Restriction Lifted for Item 44387 on 2015-05-24T10:01:23Z."],"dc:identifier":["http://hdl.handle.net/2142/44414"],"dc:language":["en"],"dc:rights":["Copyright 2013 Babak Behzad"],"dc:subject":["Parallel I/O","GIScience","High Performance Computing (HPC)","Spatial Applications","Auto-Tuning"],"dc:title":["Auto-tuned optimized parallel I/O for GIScience and spatial applications"],"dc:type":["text"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:34Z"}