Reputation: 1011
What will be the number of cores the executor takes when spark is run in local mode and also if I don't mention number of cores in command as below
./start-shell --master local
Upvotes: 3
Views: 4314
Reputation: 1011
I got the answer for my question and I just wanted to put it here. If user mentions just "local" without specifying any number of cores, it just takes only 1 core.
If its "local[N]", takes N cores If its "local[*]", takes all the cores available.
Upvotes: 11