Home Resources for Co-Design Programs Parallel-file-io Parallel-file-io_parallel-binary-multifile

Parallel File I/O (parallel-binary-multifile)

Version's name: Parallel File I/O (parallel-binary-multifile) ; a version of the Parallel File I/O program.
Repository: [home] and version downloads: [.zip] [.tar.gz] [.tar.bz2] [.tar]
Patterns and behaviours:

Sequential ASCII file I/O

Implemented best practices: Parallel multi-file I/O ·

This is the simplest parallel file I/O for binary files, each process reads or writes to its own file, i.e. the number of processes equals the number of files. This may be disadvantageous for some situations, e.g. for checkpointing if needing to restart a computation on a different number of processes.

The following pseudo-code shows the process for writing data.

get_my_process_id(proc_id)
filename = "file" + to_string(proc_id) + ".bin"
open_file(filename)
write_binary_data_to_file(data, filename)
close_file(filename)

The process is reversed when reading data from file, as follows.

get_my_process_id(proc_id)
filename = "file" + to_string(proc_id) + ".bin"
open_file(filename)
read_binary_data_from_file(data, filename)
close_file(filename)

The following experiments have been registered:

Parallel File I/O experiments

This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreements No 676553 (POP1) and 824080 (POP2).

Currently, the project receives funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 101143931 (POP3). The JU receives support from the European Union's Horizon Europe research and innovation programme and Spain, Germany, France, Portugal and the Czech Republic.