CODEWITHSUNDEEP
apache-stormapache-kafka
Global Warrior
Global Warrior

Reputation: 5120

Monitoring storm trident

I wish to setup a monitoring which checks the total messages in kafka queue and total messages already consumed by storm. If the difference is in thousands I need to setup an alert. Is there already such a tool available or how I setup this?

Upvotes: 0

Views: 429

Answers (1)

Heejin
Heejin

Reputation: 4581

Capillary tracks a delta (how Storm is far behind from Kafka) of each partition, but it seems not supporting alerts though. You may implement your own alerts by calling its API periodically.

You can also build your own alert system from the beginning through JMX. You can monitor Number of messages the consumer lags behind the producer by and alert when the lags exceed some threshold. For more information, refer to 6.6 Monitoring of Kafka documentation.

You may find some other tools from Kafka ecosystem.

Upvotes: 1

Related Questions