CODEWITHSUNDEEP
javahadoopmapreduce
Sorin
Sorin

Reputation: 61

MapReduce 2 job runs locally instead of being submitted to yarn

So i tried to configure my job to be submitted to yarn, but instead it runs locally:

config.set("yarn.resourcemanager.address", "ADDRESS:8032");
config.set("mapreduce.framework.name", "yarn"); 
config.set("fs.default.name", "hdfs://ADDRESS:8020");

If i set mapred.job.tracker it fails with: 

Exception in thread "main" org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RpcServerException): Unknown rpc kind in rpc headerRPC_WRITABLE

because its not MR1.

So why is the app not submitted to yarn?

Upvotes: 1

Views: 511

Answers (1)

Sorin
Sorin

Reputation: 61

Solved it by doing this:

config.set("yarn.resourcemanager.address", "ADDRESS:8032");
config.set("yarn.resourcemanager.scheduler.address", "ADDRESS:8030");
config.set("yarn.resourcemanager.resource-tracker.address", "ADDRESS:8031");
config.set("yarn.resourcemanager.admin.address", "ADDRESS:8033");

instead of:

config.set("yarn.resourcemanager.address", "ADDRESS:8032");

Upvotes: 1

Related Questions