Nandakishore
Nandakishore

Reputation: 1011

Number of cores by default Spark local mode takes

What will be the number of cores the executor takes when spark is run in local mode and also if I don't mention number of cores in command as below

./start-shell --master local

Upvotes: 3

Views: 4314

Answers (1)

Nandakishore
Nandakishore

Reputation: 1011

I got the answer for my question and I just wanted to put it here. If user mentions just "local" without specifying any number of cores, it just takes only 1 core.

If its "local[N]", takes N cores If its "local[*]", takes all the cores available.

Upvotes: 11

Related Questions