CODEWITHSUNDEEP
apache-kafka
Rajashekhar Meesala
Rajashekhar Meesala

Reputation: 329

Does kafka log retention applies to __consumer_offsets topic(default topic)?

We want to change log retention of our kafka topics from default to some 30 days. So we used below command to do that.

bin/kafka-configs.sh --zookeeper localhost:2181--entity-type topics --entity-name testTopic --alter --add-config retention.ms=2592000000

But what happens to __consumer_offsets topic. Does this topic also requires retention to be updated?

Upvotes: 0

Views: 2074

Answers (1)

aran
aran

Reputation: 11850

The __consumer_offsets topic retention time is controlled by the offsets.retention.minutes parameter, which is part of the broker configuration params.

After a consumer group loses all its consumers (i.e. becomes empty) its offsets will be kept for this retention period before getting discarded. For standalone consumers (using manual assignment), offsets will be expired after the time of last commit plus this retention period.

Its default value was 1440 minutes (1 day) until KIP-186, which marked the retention time to 10800 minutes (7 days) as default.

Upvotes: 1

Related Questions