CODEWITHSUNDEEP
apache-kafka
Novemberland
Novemberland

Reputation: 550

Kafka Multiple Consumers and Latency

I want to have multiple consumers subscribed to a topic with a number of partitions equal to the number of consumers.

I would like to ask if the latency of reading those messages from the partitions is increased linearly with the number of consumers (and partitions, since I have the same number of partitions and consumers) or non-linearly?

Upvotes: 0

Views: 477

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191973

Since only one consumer thread can be assigned to one partition at a time, then the total sum of all partition lags should go down faster if you have one dedicated consumer thread/application per partition.

The latency of processing the messages should also be lower because each consumer isn't trying to rebalance over more than one partition

Upvotes: 1

Related Questions