maxenglander
maxenglander

Reputation: 4051

Kafka consumer doesn't receive messages until restarted

I have tried both Kafka 0.8.2.2 and 0.9.0.0 and am seeing the same issue on both, which is this:

I start a fresh Zookeeper and Kafka server (empty data/log directories), start the consumer process for "mytopic", start the producer process for "mytopic", and then send a message through producer. The consumer does not receive the message until it is restarted.

I have tried configuring the consumer with both "earliest" and "latest" consumer offset reset strategies.

My question is - is this expected behavior? If so, is there a way to change it. If not, what is going on here?

Upvotes: 7

Views: 2067

Answers (1)

Sönke Liebau
Sönke Liebau

Reputation: 1973

If you start the consumer first with a topic that doesn't exist yet but will be auto-created by the Kafka broker this might be the same behavior as in this question. Can you try whether the solution mentioned there solves your issue?

Upvotes: -1

Related Questions