CODEWITHSUNDEEP
hadoop
Raghuveer
Raghuveer

Reputation: 3067

hadoop connection refused when trying to connect to datanode

There are 2 nodes cluster just created in hadoop. I am able to connect to master and run MR jobs but unable to connect to slave is that fine?. So i understand that namenode is not running in slave so started the node fully so that when i do a jps i see

2287 TaskTracker
2149 JobTracker
1938 DataNode
2085 SecondaryNameNode
2349 Jps
1788 NameNode

Now i can connect to slave and work as i do with master but 2 namenodes exists then it sounds something fishy, but i could be wrong. Kindly suggest.

thanks in advance

Upvotes: 0

Views: 636

Answers (1)

Lauri Peltonen
Lauri Peltonen

Reputation: 1542

When talking about small experimental clusters, you should only have one namenode (the master node). You can have any amount of datanodes - the master can also be one of them. You have to be able to connect from the master to the slaves (datanodes) with SSH without a password.

When you run MR jobs, you should check the namenode web interface to see how the job is distributed. If all of your nodes are used (for some of the jobs at least), then the setup is working.

Upvotes: 1

Related Questions