CODEWITHSUNDEEP
apache-kafka
mahdi62
mahdi62

Reputation: 1037

Querying kafka messages

I have a kafka message producer (KafkaProducer) in my spark streaming application.For this I need to detect if a message.value is already exists in the kafka before sending it in my producer

Is there any tool so I can query kafka messages? I don't want to consume message and just querying already existing messages..

Upvotes: 0

Views: 900

Answers (2)

Jack
Jack

Reputation: 5890

If you have to lookup key before inserting the value, you might need to use Hbase or MongoDB, or more options: Elasticsearch, Cassandra. Kafka is a data buffer and it's purpose is for decoupling the system. You should use the technologies on the right way :)

Upvotes: 1

miguno
miguno

Reputation: 15077

Short answer: This is not possible with built-in Kafka functionality.

Maybe you can explain why you need such functionality in your current use case, as there might be other ways to achieve what you want to do.

Upvotes: 1

Related Questions