CODEWITHSUNDEEP
apache-kafka
JIm G.
JIm G.

Reputation: 21

Kafka consumer_group name

I am new to Kafka but have watched several youtube videos on the subject. What is the value of more than one consumer being in the same consumer_group, if it will potentially prevent them from getting all messages sent by a Publisher to a given topic?

It seems that selecting a unique customer_group name per consumer is the solution?

Upvotes: 0

Views: 122

Answers (1)

Pierre Louis
Pierre Louis

Reputation: 420

If you choose a unique customer group name per consumer, each consumer will consume all the records sent to kafka.

If all consumers have the same consumer group name, they will share the consumption between them. For example, if you have three partitions in your kafka, and you have three consumers working at the same pace, they each deal with a unique partition. If you run less consumers, one consumer may be assigned multiple partitions.

Upvotes: 1

Related Questions