Reputation: 881
We have a dataproc cluster with 10 Nodes and unable to understand how to set the parameter for --num-executor for spark jobs.
Below are the points which are confusing -
Upvotes: 2
Views: 209
Reputation: 6011
An executor is just a Java process running running on their own JVM on some machine somewhere.
To answer your questions:
Hope this helps!
Upvotes: 1