CODEWITHSUNDEEP
scalaapache-spark
Eugene Goldberg
Eugene Goldberg

Reputation: 15524

how to properly submit a spark job?

I have some scala / spark code, packaged into sparktest_2.10-1.0.jar file I'm trying to do spark-submit: 

spark-submit --class sparktest_2.10-1.0 --master local[2]

I get: Error: Must specify a primary resource (JAR or Python or R file)

What is the proper way to do spark-submit ?

Upvotes: 1

Views: 837

Answers (1)

Knight71
Knight71

Reputation: 2949

spark-submit
  --class "main-class"
  --master spark://master-url
  --deploy-mode "deploy-mode"
  --conf <key>=<value>  
  ... # other options
  application-jar
  [application-arguments]

Eg: 

spark-submit --class "com.example.myapp" myapp.jar

Upvotes: 2

Related Questions