CODEWITHSUNDEEP
apache-sparkpyspark
None
None

Reputation: 1468

How to submit pyspark job in yarn cluster mode from code

Can we submit a pyspark job in yarn cluster mode from Python code.

Upvotes: 0

Views: 5585

Answers (1)

Sahil Desai
Sahil Desai

Reputation: 3696

spark-submit is the command for submit the pyspark job on spark and we have to mention yarn cluster mode for deploy the job on cluster.

spark-submit --master yarn --deploy-mode cluster  py_files.py

Upvotes: 1

Related Questions