The following is a list of free open source software projects developed by HPC-5.
Updated November 10th, 2007
MPI-FTW
This program is used to traverse a directory tree using MPI.
Each time a new directory is located, a process is allocated to walk that
particular branch. Upon completion, this program will provide directory
count, file count and time to complete statistics. This program also
accepts an argument that states that commands are to be run on each
directory found.
The MPI-FTW Test is open sourced under LA-CC-06-077.
This section contains examples of modified mpi_ftw that perform specific
functions:
pstat is a modified mpi_ftw that purges files and reports file system
statistics. This is an early version so the purging option (-f) is not
recommended at this time.
MPI-IO Test
Although there are a host of existing file system and I/O test programs available,
most are not designed with parallel I/O in mind and are not useful at the scale of the
clusters at Los Alamos National Lab (LANL). LANL's MPI-IO Test was written with parallel
I/O and scale in mind. The MPI-IO test is built on top of MPI's I/O calls and is used to
gather timing information for reading from and writing to file(s) using a variety of I/O profiles; N processes writing to N files, N processes writing to one file, N processes sending data to M processes writing to M files, or N processes sending data to M processes to one file. These diagrams illustrate the various I/O access patterns. A data aggregation capability is available and the user can pass down MPI-IO, ROMIO and file system specific hints. The MPI-IO Test can be used for performance benchmarking and, in some cases, to diagnose problems with file systems or I/O networks.
The MPI-IO Test is open sourced under LA-CC-05-013.
Rompio
Software designed to measure MPI collective, independent, asynchonous, and POSIX file I/O performance, synthesizing how applications utilize file systems in the LANL ASC computing environment. File layouts include N processors to N files and N processors to 1 file. Write access patterns include non-strided and strided. Pure network performance measures can also be obtained for relevant MPI collective calls. Refer to the README file for a detailed description of input and output.
The MPI-FTW Test is open sourced under LA-CC-06-018.
