CODEWITHSUNDEEP
performancelucenestreamapache-kafkamessage-queue
FindingTheOne
FindingTheOne

Reputation: 189

Kafka for real time data processing multiple consumers

I am interested in using Kafka to stream data (100 K records per second) that has to be consumed by multiple consumers(nosql, lucene) and wanted to know if Kafka is good resource for my requirements or any alternative that are useful as well. The consumers consume data are:

Consumer 1 - consumes data as soon as it comes to topic.
Consumer 2 - consumes data in batches from topic

Upvotes: 1

Views: 537

Answers (1)

Kamal Chandraprakash
Kamal Chandraprakash

Reputation: 1992

Yes, Kafka is a perfect fit for your requirement. Read about Kafka Streams here

If you want to read the data in batches, use the Kafka Consumer

Upvotes: 1

Related Questions