CODEWITHSUNDEEP
hadoop-yarngoogle-cloud-dataproclivy
Deepak Verma
Deepak Verma

Reputation: 673

Unable to kill application from Yarn RM UI

I have dataproc setup on google cloud platform with apache livy installed. I am submitting jobs using livy rest api. When I try to kill livy jobs from Yarn RM, I am getting below error in browser console tab.

{"RemoteException":{"exception":"AuthorizationException","message":"Unable to obtain user name, user not authenticated","javaClassName":"org.apache.hadoop.security.authorize.AuthorizationException"}}

When I open Yarn RM. I am not sure how to setup user authentication for Yarn RM Web interface. Also when I open yarn ui, it does not ask me any username and password.

However I am able to kill application using below command 

yarn application -kill application_id

Upvotes: 1

Views: 1396

Answers (1)

Karthik Palaniappan
Karthik Palaniappan

Reputation: 1383

As discussed here, this is a regression in Dataproc 1.3, assuming you are using that image version.

You would also hit this issue if you used the Tez init action on older Dataproc versions, since it also installs and configures the app timeline server.

You just need to set hadoop.http.filter.initializers=org.apache.hadoop.security.HttpCrossOriginFilterInitializer,org.apache.hadoop.http.lib.StaticUserWebFilter.

I plan to fix this in Dataproc 1.3 (will roll out in the next couple weeks), and I filed an issue for the Tez init action.

Upvotes: 1

Related Questions