CODEWITHSUNDEEP
google-cloud-platformgoogle-cloud-dataproc
Remis Haroon - رامز
Remis Haroon - رامز

Reputation: 3572

Performance monitoring for Google Cloud DataProc

We are using GoogleCloudPlatform for big-data analytics. For processing we are currently using the google cloud dataproc & spark-streaming.

We would like to check the job performance using some monitoring utilities like Ganglia, Graphite, Dr.Elephant etc.

For setting up of any of these requires modification of configuration in each nodes. I would like to know, if the dataproc natively supports any of such performance monitoring tools?

Upvotes: 0

Views: 997

Answers (1)

Patrick Clay
Patrick Clay

Reputation: 1349

None of those are supported out of the box, but you could add Ganglia using this initialization action. You can configure it however you like by editing the script.

You would then have to follow these instructions to access the Web UI.

Upvotes: 3

Related Questions