teeboy
Reputation: 408
Topic explosion in mirrormaker 2
Does mirrormaker 2 need 6 system topics (on both sides of the wire) for each topic to be replicated? I am concerned this could lead to topic explosion. we need two-way sync between kafka clusters
Upvotes: 0
Views: 1168
Answers (1)
OneCricketeer
Reputation: 191738
Three of those topics are for Kafka Connect, not MirrorMaker2 (configs, offsets, and status}.
No, none of those are unique to each mirrored topic, but rather the Kafka Connect cluster and its group id. You can run multiple mirrors in the same Connect cluster, thereby not creating new set of internal topics.
Upvotes: 1
Related Questions
- Adding new topics to Mirror maker configuration
- MirrorMaker2 does not mirror all messages from a compacted topic?
- Disable mirrormaker2 offset-sync topics on source kafka cluster
- kafka MirrorMaker 2.0 does not replicate data
- Kafka MirrorMaker - Deletion of a topic is not replicated
- Kafka MirrorMaker 2.0 duplicate each messages
- Kafka Mirror Maker not Replicating topics when source and destination clusters are not in the same configuration
- Kafka Mirror Maker : Sync __consumer_offsets topic duplicates
- Kafka MirrorMaker Woes
- Mirror maker target topic name different from source topic name