CODEWITHSUNDEEP
apache-sparkgoogle-cloud-dataproc
femibyte
femibyte

Reputation: 3507

Google Cloud Dataproc migration to Spark 1.6.0

Will Google Dataproc start using Spark 1.6.0 anytime soon ? I'm creating a cluster using this command:

gcloud beta dataproc clusters create <cluster-name>

and it defaults to using Spark 1.5.2.

Thanks.

Upvotes: 0

Views: 153

Answers (2)

James
James

Reputation: 2331

You can expect to see a new image version for Google Cloud Dataproc which contains Spark 1.6.x within the coming weeks.

Upvotes: 3

Daniel Darabos
Daniel Darabos

Reputation: 27455

https://cloud.google.com/dataproc/dataproc-versions lists the available versions. Currently you have a choice of Spark 1.5.0 or Spark 1.5.2 (the default).

Upvotes: 0

Related Questions