CODEWITHSUNDEEP
c++parallel-processingsynchronizationmpi
user3616495
user3616495

Reputation: 83

Make slaves wait for each other in MPI

I have a master-slave model in my MPI program. I want to make slaves wait for each other before going to the next iteration.

if (rank == 0) {
    // master process
} else {
    // slave process
    for (int i = 0; i < 10; i++) {
        // do stuff
        // wait for all slaves to end iteration i
    }
}

Basically, I don't want any processor to go into next iteration without all other slaves complete their current iteration. How can I do this? With MPI_Barrier?

Upvotes: 1

Views: 1285

Answers (1)

Gilles
Gilles

Reputation: 9489

You can create a communicator comprising with all slave processes and use it on a MPI_Barrier(). Fro creating this communicator, the simplest / safest is to use MPI_Comm_split() this way:

MPI_Comm slaves;
MPI_Comm_split( MPI_COMM_WORLD, ( rank == 0 ), rank, &slaves );

This will actually globally create 2 communicators: one comprising only the master process and one comprising all processes but the master.

For actual use, you can do it this way:

if (rank == 0) {
    // master process
} else {
    // slave process
    for (int i = 0; i < 10; i++) {
        // do stuff
        // wait for all slaves to end iteration i
        MPI_Barrier( slaves );
    }
}

Upvotes: 3

Related Questions