Reputation: 289
Verify if Kafka queue is empty
We have pushed messages onto kafka queues 2 days back and the retention is set to 2 days so its going to expire today . Is there any way of knowing exactly when kafka queues are empty/not having any data in them?
I am a beginner in Hadoop system so I don't know if there is any command to find this/easy way to verify the empty queues
Upvotes: 0
Views: 5599
Answers (2)
Reputation: 327
After you create consumer, before assigning any partition to it check:
If consumer.position(topicPartition) is equal to consumer.endOffsets(List.of(topicPartition)) - then there is nothing to consume.
Upvotes: 0
Reputation: 62350
You can write a own little tool using KafkaConsumer laveraging seekToEnd(), seekToBeginning(), and position() to get min and max offsets per partition. If both match for all partitions, the topic is empty.
Upvotes: 1
Related Questions
- How to check if Kafka Consumer is ready
- How to check if Kafka is empty using Spring Kafka?
- Check if a Kafka topic had ever received any data
- Good way to check if Kafka Consumer doesn't have any records to return and is empty in java?
- Apache Kafka: How to check, that an event has been fully handled?
- How to check Kafka server status or details?
- Kafka - Consume until empty
- check if kafka client producer is running before sending messages in java
- Kafka check queue size
- Check if Kafka Queue is Empty