Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 16 of 16 for “"Parallel file system"”.
-
Parallel file system with tunable consistency
Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms
-
Towards Automatic Load Balancing of a Parallel File System with Subfile Based Migration
… congestion of network as well as of the I/O subsystem to ensure maximum concurrency and thus efficiency. Load balancing is a technique which tackles this issues. While load balancing has been evaluated in detail for computational parts of a program, analysis of load imbalance for complex storage …
-
Automatic Classification of Input/output Access Patterns
… framework as extensions to the Portable Parallel File System (PPFS) testbed. Experimental results on sequential and parallel scientific applications demonstrate the utility of this approach.
-
Optimizing Parallel Input/output Using Adaptive File System Policies
… approach via several extensions to the Portable Parallel File System (PPFS) testbed. Sensor metrics that summarize dynamic access pattern information and file system performance effectively guide adaptive policy selection, affording significant performance improvements over less adaptive …
-
Measurement-Based Characterization of Parallel I/O Systems
… the issue of evaluating the performance of parallel I/O subsystems for a variety of I/O intensive workloads on massively parallel systems. First, a model-based workload specification methodology for generating parallel I/O intensive workloads is described. Second, a synthetic workload …
-
Rethinking the design and implementation of the i/o software stack for high-performance computing
… a widely used storage medium in high-end storage systems. </p> <p>In this dissertation, we experimentally demonstrated such issues in four different layers, including operating system process management layer and MPI-IO middleware layer on compute server side, and parallel file system layer and …
-
Optimizing parallel I/O performance of HPC applications
Parallel I/O is an essential component of modern High Performance Computing (HPC). Obtaining good I/O performance for a broad range of applications on diverse HPC platforms is a major challenge, in part because of complex inter-dependencies between I/O middleware and hardware. The parallel file …
-
Auto-tuned optimized parallel I/O for GIScience and spatial applications
… bottleneck of using high-performance computing systems as we are heading towards the Exascale era. An unprecedented amount of data is being produced everyday by different sources. On the other hand, the computation power of HPC systems is getting scaled to hundreds of thousands cores. However, …
-
AnalyzeThis: An Analysis Workflow-Aware Storage System
… to as an end-to-end workflow. Extant workflow systems are stymied by the storage wall, resulting from both the disk-based parallel file system (PFS) failing to keep pace with the compute and memory subsystems as well as the inefficiencies in end-to-end workflow processing. In the post-petaflop …
-
Detecting and understanding crash-consistency bugs across the parallel I/O stack
Parallel file systems (PFS’es) and parallel I/O libraries have been the backbone of high- performance computing (HPC) infrastructures for decades. However, their crash consistency bugs have not been extensively studied, and bug-finding or testing tools for identifying them are lacking. In this …
-
Accelerated Storage Systems
… of a large number of high-performance storage systems, arguably the most important of which are Key-Value (KV) stores. An emerging trend for achieving low latency and high throughput in this space is a solution, which utilizes both DRAM and flash by storing an efficient index for the data in …
-
Research on High-performance and Scalable Data Access in Parallel Big Data Computing
… many dedicated data-intensive storage systems such as Google File System(GFS), Hadoop Distributed File System(HDFS) and Quantcast File System(QFS) have been developed. Currently, the Hadoop Distributed File System(HDFS) [20] is the state-of-art and most popular open-source distributed …
-
Coherencia de Cache en Sistemas de Ficheros para Entornos Distribuidos y Paralelos
… in processors, memories and communication subsystems, has led the I/O subsystems to become a bottleneck in many computer systems. This problem, defined as the I/O crisis, has been mainly addressed using parallelism and caching in the I/O subsystem. Caching improves I/O performance, both for …
-
An Integrated End-User Data Service for HPC Centers
The advent of extreme-scale computing systems, e.g., Petaflop supercomputers, High Performance Computing (HPC) cyber-infrastructure, Enterprise databases, and experimental facilities such as large-scale particle colliders, are pushing the envelope on dataset sizes. Supercomputing centers routinely …