Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 15 of 15 for “"Parallel I/O"”.
-
Parallel I/O on Compressed Data Files
… leading to an imbalance in cluster and parallel computing architectures where input-output (I/O) operations may bottleneck the overall performance of the system. This makes necessary the use of sophisticated software solutions to overcome limitations on I/O performance. One method is to …
-
Optimizing parallel I/O performance of HPC applications
Parallel I/O is an essential component of modern High Performance Computing (HPC). Obtaining good I/O performance for a broad range of applications on diverse HPC platforms is a major challenge, in part because of complex inter-dependencies between I/O middleware and hardware. The parallel file …
-
Measurement-Based Characterization of Parallel I/O Systems
… the issue of evaluating the performance of parallel I/O subsystems for a variety of I/O intensive workloads on massively parallel systems. First, a model-based workload specification methodology for generating parallel I/O intensive workloads is described. Second, a synthetic workload …
-
Machine learning for selecting parallel I/O benchmark applications
I/O is one of the main performance bottlenecks for many data-intensive scientific applications. Accurate I/O performance benchmarking, which can help us better understand the causes of these bottlenecks and to guide the performance optimization of poor performing applications, is therefore an …
-
Competitive prefetching and buffer management for parallel I/O systems
… prefetching and buffer management algorithms for parallel I/O systems. Two models of lookahead, global and local, which give limited information regarding future accesses are introduced. Two configurations of the I/O buffer, shared and distributed, are considered, based upon the accessibility of …
-
Efficient Resource Utilization for Parallel I /O in Cluster Environments
In this thesis work, performance factors for parallel I/O on clusters are examined and several algorithms are designed to support parallel I/O efficiently for scientific applications running on commodity clusters, making better utilization of system resources. Specifically, our algorithms are …
-
Auto-tuned optimized parallel I/O for GIScience and spatial applications
… science. In this thesis, we have implemented a parallel I/O library specialized for spatial data analysis in GIScience, capable of treating different I/O patterns such as Row-Wise, Column-Wise and Block-Wise I/O. We then establish an auto-tuning framework for finding optimal parallel I/O …
-
Detecting and understanding crash-consistency bugs across the parallel I/O stack
Parallel file systems (PFS’es) and parallel I/O libraries have been the backbone of high- performance computing (HPC) infrastructures for decades. However, their crash consistency bugs have not been extensively studied, and bug-finding or testing tools for identifying them are lacking. In this …
-
Efficient Data Organization and Load Balancing on Parallel Disks
… proposed approaches on IBM SP2s, using the Panda parallel I/O library as a testbed, show that our strategies significantly reduce the I/O time required for the checkpoint and snapshot operations of large simulations.
-
Supporting I/O for Remote Visualization of High-Performance Scientific Simulations
… the results of experiments with the Panda parallel I/O library that show that our proposed approach to data migration can reduce application turnaround time significantly. We also show that our declustering approaches can reduce the retrieval time for visualization queries on heterogeneous …
-
Scalable Data Management for Object-based Storage Systems
Parallel I/O performance is crucial to sustain scientific applications on large-scale High-Performance Computing (HPC) systems. Large scale distributed storage systems, in particular the object-based storage systems, face severe challenges for managing the data efficiently. Inefficient data …
-
Hardware-based Parallel Simulation of Flexible Manufacturing Systems
This research explores a hardware-based parallel simulation mechanism that can dramatically improve the speed of simulating flexible manufacturing systems (FMS) by applying appropriate enabling hardware technologies. The hardware-based parallel simulation refers to running a simulation on a …
-
Compiler and Runtime Approach for Supporting Efficient Execution of Coarray Fortran Programs
… standard which aim to support the development of parallel programs without requiring the use of external constructs such as libraries (e.g. MPI) or directives (e.g. OpenMP). Coarrays provide a Partitioned Global Address Space (PGAS) approach to parallel programming in which the programmer declares …
-
Optimizing I/O performance for high performance computing applications: from auto-tuning to a feedback-driven approach
The 2014 TOP500 supercomputer list includes over 40 deployed petascale systems, and the high performance computing (HPC) community is working toward developing the first exaflop system by 2023. Scientific applications on such large-scale computers often read and write a lot of data. With such rapid …
-
Scalability Analysis and Optimization for Large-Scale Deep Learning
Despite its growing importance, scalable deep learning (DL) remains a difficult challenge. Scalability of large-scale DL is constrained by many factors, including those deriving from data movement and data processing. DL frameworks rely on large volumes of data to be fed to the computation engines …