CODEWITHSUNDEEP
apache-kafkakafka-consumer-api
POV
POV

Reputation: 12025

What is benefit of partition in Kafka?

So, let's comparable Kafka and RabbitMQ.

Kafka(Partition) = RabbitMQ(Queue)

Queue contains all messages like list.

What is benefit of partition in Kafka, why not use messages only in one partition?

Is it only fore replication?

Upvotes: 1

Views: 5116

Answers (2)

Jin Lee
Jin Lee

Reputation: 3522

If you have many partitions, when one partition goes down, you can still read from another (replication).

Also, many partitions mean higher throughput. Producers can produce faster and more. And consumers can consume more and faster (using Consumer group)

As your system gets bigger and bigger, you can just add more partitions without stopping your system.

enter image description here

enter image description here

Upvotes: 2

Yannick
Yannick

Reputation: 1418

Kafka is not a queue, you cannot have selective acknowledgenents, which makes it way less usable as a queue.

There is already a subject not so far from your question ( actually, it's more the reverse, why Kafka and not a queue) :

Is there any reason to use RabbitMQ over Kafka?

To complete, and to answer more your question, in the other hand, Kafka partitions permit an easy transparent scaling out, by just playing with the numbers of partitions for a topic ( that would fit the number of consumers in a consumer group).

Yannick

Upvotes: 1

Related Questions