CODEWITHSUNDEEP
apache-spark
Anuj Mehra
Anuj Mehra

Reputation: 320

Does any of the executors run on the driver node in cluster deploy mode?

While running a program in Cluster mode, does any executor also run on the node on which the Driver Program is running.

Following text explains about the cluster mode: https://spark.apache.org/docs/latest/cluster-overview.html

But doesn't answer this question.

Thanks Anuj

Upvotes: 1

Views: 213

Answers (1)

user8963673
user8963673

Reputation: 26

This depends on the cluster manger implementation, configuration and requested resources. In general cluster manager is free to start multiple containers on the same physical node.

So without additional assumptions - driver can be, but doesn't have to be, colocated with one or more executors.

Upvotes: 1

Related Questions