CODEWITHSUNDEEP
apache-storm
user4974500
user4974500

Reputation: 139

Swapping a existing topology with a new one

I have added new bolts in my storm topology and want to swap the existing topology with the new one.How can i achieve it in such a way that when the second topology starts it does not read the same messages again.

Upvotes: 0

Views: 395

Answers (1)

Morgan Kenyon
Morgan Kenyon

Reputation: 3172

If you're reading from Kafka using the Storm provided Kafka Spout, it stores its offset in Zookeeper. If you keep the id defined in SpoutConfig the same, every time the Kafka Spout restarts it should check Zookeeper and restart from the last committed offset. Achieving your goal of not reading the same messages again.

Upvotes: 2

Related Questions