학술논문

MPI-IO/GPFS, an Optimized Implementation of MPI-IO on Top of GPFS
Document Type
Conference
Source
ACM/IEEE SC 2001 Conference (SC'01) Supercomputing, ACM/IEEE 2001 Conference. :58-58 2001
Subject
Computing and Processing
Prototypes
File systems
Performance gain
Government
Laboratories
Message passing
Prefetching
Benchmark testing
Machinery
Parallel programming
MPI-IO
GPFS
file hints
prefetching
data shipping
double buffering
performance
optimization
benchmark
SMP node
Language
Abstract
MPI-IO/GPFS is an optimized prototype implementation of the I/O chapter of the Message Passing Interface (MPI) 2 standard. It uses the IBM General Parallel File System (GPFS) Release 3 as the underlying file system. This paper describes optimization features of the prototype that take advantage of new GPFS programming interfaces. It also details how collective data access operations have been optimized by minimizing the number of messages exchanged in sparse accesses and by increasing the overlap of communication with file access. Experimental results show a performance gain. A study of the impact of varying the number of tasks running on the same node is also presented.