CODEWITHSUNDEEP
amazon-s3hiveemr
Fon
Fon

Reputation: 36

Amazon EMR how to find out when job is finish?

I'm using Amazon Elastic MapReduce Ruby (http://aws.amazon.com/developertools/2264) to run my hive job. Is there a way to know when the job is done? Right now all I could think of is the keep running emrclient with "--list --active" but I'm hoping there is a better way to do this.

Thank you

Upvotes: 1

Views: 715

Answers (1)

Amar
Amar

Reputation: 12010

You may also get to know this from the aws console's EMR section.

If your concern is to terminate the cluster once your job is done then while launching the cluster don not use the option --stay-alive. Or alternatively, you can have a script which would poll for the current status of the running cluster and terminate it once it gets to 'waiting' state.

I do not think there is another way.

Upvotes: 3

Related Questions