{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/116191"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/116191","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Parallel file system with tunable consistency","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","abstract_has_math":false,"creators":["Wang, Chen"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":["Snir, Marc","Mohror, Kathryn","Huang, Jian","Winslett, Marianne","Gropp, William"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-08","date_published":"2022-08","updated_at":"2026-07-22T22:24:55Z","subjects":["Parallel file system","Consistency model","Tunable consistency","Parallel Storage","I/O Tracing","MPI Tracing"],"languages":["en","eng"],"rights":["Copyright 2022 Chen Wang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/116191","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Snir, Marc","Mohror, Kathryn","Huang, Jian","Winslett, Marianne","Gropp, William"]},{"key":"dc:creator","label":"Author","values":["Wang, Chen"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-08","2022-07-08"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Parallel file system","Consistency model","Tunable consistency","Parallel Storage","I/O Tracing","MPI Tracing"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Chen Wang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/116191"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","The student, Chen Wang, accepted the attached license on 2022-07-07 at 15:27.","The student, Chen Wang, submitted this Dissertation for approval on 2022-07-07 at 15:31.","This Dissertation was approved for publication on 2022-07-08 at 12:49.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18170 on 2022-11-15 at 17:38:17","In high performance computing (HPC) systems, the I/O demands of applications are supported by parallel file systems such as Lustre and GPFS. Most general-purpose parallel file systems (PFS) support the POSIX I/O interface and its consistency model. However, the POSIX standard was defined decades ago for use by a single machine with a single storage device. It is not fit for highly concurrent applications typically seen on modern HPC systems. The major impediment to the PFS performance is the strict adherence to POSIX consistency semantics, which requires sequential consistency in general and atomicity for many operations. The strict enforcement of these requirements impedes caching, generates significant additional traffic, and results in congestion in situations of high sharing, especially for small block reads and writes. The use of the POSIX consistency model for I/O has plagued the HPC community for many years, but it is becoming more problematic due to two key reasons: (1) the rapid increase in the scale of HPC systems; (2) the emergence of the new storage techniques such as persistent memory. They make the overhead of maintaining POSIX consistency relatively higher. Many efforts have been made toward PFSs with relaxed consistency semantics. However, different applications have different consistency requirements. A PFS providing a static consistency model will not work ideally for every application. Moreover, the correctness is not guaranteed if the provided consistency model is weaker than the desired one. In this dissertation, we first propose a multi-level I/O and MPI tracing tool. We then collect detailed traces from 17 representative HPC applications and I/O benchmarks. Next, we employ a trace-driven analysis approach to study the consistency requirements of these applications. And finally, based on this study, we propose and design a parallel file system that provides tunable consistency models."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Parallel file system with tunable consistency"]}]}],"canonical_facts":{"dc:contributor":["Snir, Marc","Mohror, Kathryn","Huang, Jian","Winslett, Marianne","Gropp, William"],"dc:creator":["Wang, Chen"],"dc:date":["2022-08","2022-07-08"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms","The student, Chen Wang, accepted the attached license on 2022-07-07 at 15:27.","The student, Chen Wang, submitted this Dissertation for approval on 2022-07-07 at 15:31.","This Dissertation was approved for publication on 2022-07-08 at 12:49.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18170 on 2022-11-15 at 17:38:17","In high performance computing (HPC) systems, the I/O demands of applications are supported by parallel file systems such as Lustre and GPFS. Most general-purpose parallel file systems (PFS) support the POSIX I/O interface and its consistency model. However, the POSIX standard was defined decades ago for use by a single machine with a single storage device. It is not fit for highly concurrent applications typically seen on modern HPC systems. The major impediment to the PFS performance is the strict adherence to POSIX consistency semantics, which requires sequential consistency in general and atomicity for many operations. The strict enforcement of these requirements impedes caching, generates significant additional traffic, and results in congestion in situations of high sharing, especially for small block reads and writes. The use of the POSIX consistency model for I/O has plagued the HPC community for many years, but it is becoming more problematic due to two key reasons: (1) the rapid increase in the scale of HPC systems; (2) the emergence of the new storage techniques such as persistent memory. They make the overhead of maintaining POSIX consistency relatively higher. Many efforts have been made toward PFSs with relaxed consistency semantics. However, different applications have different consistency requirements. A PFS providing a static consistency model will not work ideally for every application. Moreover, the correctness is not guaranteed if the provided consistency model is weaker than the desired one. In this dissertation, we first propose a multi-level I/O and MPI tracing tool. We then collect detailed traces from 17 representative HPC applications and I/O benchmarks. Next, we employ a trace-driven analysis approach to study the consistency requirements of these applications. And finally, based on this study, we propose and design a parallel file system that provides tunable consistency models."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/116191"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Chen Wang"],"dc:subject":["Parallel file system","Consistency model","Tunable consistency","Parallel Storage","I/O Tracing","MPI Tracing"],"dc:title":["Parallel file system with tunable consistency"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:55Z"}