CODEWITHSUNDEEP
hadoopapache-zookeeper
aman446
aman446

Reputation: 31

can single point of failure in Hadoop can be addressed by integrating Zookeeper?

I am looking for addressing the issue of single point failure by integrating Zookeeper and allow Hadoop to use the namespace from Zookeeper? Is it possible? how can we address this ?

Upvotes: 3

Views: 510

Answers (2)

Igor Katkov
Igor Katkov

Reputation: 6380

That would not work very well. Cost of write in Zookeeper is high. The more nodes you have in ZK cluster the higher the cost. ZK keeps all the data in memory on all nodes. Namenode is on the contrary write focused component, especially if you talking about Hadoop, which is super write heavy.

Upvotes: 0

Donald Miner
Donald Miner

Reputation: 39903

Sure, it might be technically possible, but this is not something that has been implemented in any shape or form just yet. You can't just plug it into ZooKeeper... it'll take some engineering effort to get it done (by you perhaps?!).

Here are a couple pointers to solutions of this:

Upvotes: 2

Related Questions