CODEWITHSUNDEEP
javaapache-kafkaapache-zookeeper
Punter Vicky
Punter Vicky

Reputation: 16992

Kafka - Offset and logSize

I see the below details when looking up the ddetails of Kafka logs. Does this mean that there are a total of 17905513 messages out of which 17905510 have already been read and 3 are pending to be read?

Offset      logSize     Lag 
17905510    17905513    3

Upvotes: 2

Views: 1868

Answers (1)

Lukáš Havrlant
Lukáš Havrlant

Reputation: 4414

Almost. Kafka saves the offset from time to time (it depends on settings). It doesn't save the offset after every message has been read or processed. Thus it may means that the Consumer haven't read the last three messages yet but it may also means that it has read all pending messages but the offset in ZK hasn't been updated yet.

Upvotes: 3

Related Questions