Reputation: 31
I am getting this Kafka Storage Exception : Halting due to unrecoverable IO error in handling produce requests exception periodically in every 3-4 days from some time. It causes my broker to shutdown which causes uncommitted offsets resulting in loss of data.
Can someone please suggest reason for the same.
Upvotes: 1
Views: 1176
Reputation: 346
One of the reasons could be If you are using windows machine to run kafka broker.Kafka logs might be getting stored in windows drive(C:) . Try changing the kafka logs Dir from C: drive to D: \ drive and never faced the issue.
Ensure that you disk has enough space. Try deleting Kafka-logs dir(Please do not even think of trying this in production) and perform zookeeper logs clean up as well.
Upvotes: 1