Reputation: 537
How to introduce delay in rebalancing in case of kafka consumer group?
I want to give some time to my consumer to restart so that unnecessary rebalance doesnt happen. How can I do that? In case of shutdown, I want replication to come in picture and after some time if consumer is not back up, rebalance should occur else not.
Upvotes: 7
Views: 12546
Answers (2)
Reputation: 3191
Looks like this was addressed in the meantime with client configuration:
https://github.com/tulios/kafkajs/issues/1237
Upvotes: 0
Reputation: 125
There's broker level config called group.initial.rebalance.delay.ms you can tweak.
The amount of time the group coordinator will wait for more consumers to join a new group before performing the first rebalance. A longer delay means potentially fewer rebalances, but increases the time until processing begins.
https://kafka.apache.org/documentation/
Upvotes: 4
Related Questions
- How to load balance Kafka consumers within a consumer group
- Kafka Consumer group rebalancing
- Kafka wait for minimal number of consumers (clients) in KStream
- Kafka-streams delay to kick rebalancing on consumer graceful shutdown
- Kafka Consumer Rebalancing takes too long
- Kafka rebalance the data in a topic due to slow(er) consumer
- Kafka Stream Aggregator - how to set time to wait in aggregations before spitting messages?
- Kafka Consumer rebalance with only one consumer in a group
- Conditions in which Kafka Consumer (Group) triggers a rebalance
- How to specify starting position for Kafka consumers when using dynamic group re-balancing?