CODEWITHSUNDEEP
apache-kafkakafka-producer-api
TLD
TLD

Reputation: 8135

Behaviour of KafkaProducer when the connection to Kafka stream is broken

I was expecting that KafkaProducer will throw timeout exception when the connection to brokers is broken (e.g. losing internet access, brokers is not available...), but from what I observed, KafkaProducer still performed the sending normally without any problem. (I set Ack to no).

I checked its documentation and there is no part about how the KafkaProducer will behave when the connection to brokers is broken/ restored.

Does anyone have experiences with this? I'm using Kafka version 0.10, with asynchronous send and handle error in callback.

Upvotes: 2

Views: 1584

Answers (1)

Matthias J. Sax
Matthias J. Sax

Reputation: 62310

First, I want to clarify that Kafka Streams is Apache Kafka's stream processing library and your question seems not to be about Kafka Streams. You only talk about producer and brokers (just want to clarify terminology to avoid future confusion).

About your question: The only way to check if a write to a broker was successful is by enabling acks. If you disable acks, the producer applies a "fire and forget" strategy and does not check if a write was successful and/or if any connection to the Kafka cluster is still established etc.

Because you do not enable acks, you can never get an error callback. This in independent of sync/async writing.

Upvotes: 3

Related Questions