CODEWITHSUNDEEP
hadoophadoop-yarncloudera
NissesSenap
NissesSenap

Reputation: 31

Put yarn nodemanager in maintenance

I'm a part of a team that is running hadoop cloudera 5.13 implementation.

I am wondering if there is a way to set yarn nodemanagers in maintenance, thus running it renaming containers but not accept any new ones?

I do not have the cloudera enterprise solution.

Tried to find something good with the cli tool yarn rmadmin but was unable to do so.

Or is the only thing I can do shutdown the nodemanager and have my users containers die?

Upvotes: 1

Views: 1154

Answers (1)

tk421
tk421

Reputation: 5967

What you're looking for is called Graceful decommissioning.

In YARN (MR2 Included) Properties in CDH 5.9.0 the property yarn.resourcemanager.nodemanager-graceful-decommission-timeout-secs allows you to control how many seconds the NM will wait on existing containers to finish before decommissioning.

The main design JIRA is:

https://issues.apache.org/jira/browse/YARN-914 - (Umbrella) Support graceful decommission of nodemanager

Upvotes: 1

Related Questions