CODEWITHSUNDEEP
rparallel-processingdomc
Marcelo
Marcelo

Reputation: 183

R in parallel using doMC library: How to reuse cores for subsequent parallel processes?

When running the following script in R:

library(doMC)
registerDoMC(cores=3)

# First foreach
# This runs in 3 threads
foreach(i=1:3) %dopar% sqrt(i)

# Second foreach 
# This add 3 threads to the previous ones (now inactive but still consuming memory), totalling 6 threads
foreach(i=1:3) %dopar% sqrt(i)

I would like to know how to reuse the threads of the first foreach when running the second one, so that the whole script always runs using 3 cores.

Upvotes: 2

Views: 406

Answers (1)

Marcelo
Marcelo

Reputation: 183

Thanks to the suggestion of one of doMC's developers, I could find a workaround. Using a different library, the following code does what I was looking for:

library(doParallel)
cores=makeForkCluster(3)
registerDoParallel(cores)

# First foreach
# This runs in 3 threads
foreach(i=1:3) %dopar% sqrt(i)

# Second foreach 
# This reuses the previous 3 threads (total of 3 active threads)
foreach(i=1:3) %dopar% sqrt(i)

Upvotes: 1

Related Questions