CODEWITHSUNDEEP
apache-kafkaapache-zookeeper
The-Proton-Resurgence
The-Proton-Resurgence

Reputation: 818

multiple kafka clusters on single zookeeper ensemble

I currently have a 3 node Kafka cluster which connects to base chroot path in my zookeeper ensemble.

zookeeper.connect=172.12.32.123:2181,172.11.43.211:2181,172.18.32.131:2181

Now, I want to add a new 5 node Kafka cluster which will connect to some other chroot path in the same zookeeper ensemble.

zookeeper.connect=172.12.32.123:2181,172.11.43.211:2181,172.18.32.131:2181/cluster/2

Will these configurations work as in the relative paths for the two chroots? I understand that the original Kafka cluster should have been connected on some path other than the base chroot path for better isolation.

Also, is it good to have same zookeeper ensemble across Kafka clusters? The documentation says that it is generally better to have isolated zookeeper ensembles for different clusters.

Upvotes: 0

Views: 3421

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191671

If you're only limited to a single Zookeeper cluster, then it should work out fine with a unique chroot that doesn't collide with the other cluster's znodes.

It is not "good" to share, no, because Zookeeper losing quorum causes two clusters to be down, but again if you're limited on hardware, then it'll still work

Note: You can only afford to lose one ZK server with 3 nodes in the cluster, which is why a cluster of 5 is recommended

Upvotes: 5

Related Questions