CODEWITHSUNDEEP
apache-kafkaapache-zookeeperkafka-consumer-apispring-kafka
Divs
Divs

Reputation: 1618

Kafka Offsets.storage

What is the "offsets.storage" for kafka 0.10.1.1?

As per the documentation it shows up under Old Consumer Configs as "zookeeper".

offsets.storage zookeeper Select where offsets should be stored (zookeeper or kafka).

My consumer is spring-boot-1.5.13 RELEASE app which uses kafka-clients-0.10.1.1 internally. As per the source code ConsumerConfig.scala, offsetStorage is "zookeeper", but when I run the consumer, I see the "__consumer_offsets" are getting created under /tmp/kafka-logs directory which is defined in server.properties [i.e. broker];

Moreover it doesn't show up under zookeeper ephemeral nodes, when I check with zookeeper-shell.sh.

ls /consumers []

If the offsets.stroage is zookeeper, then why does the __consumer_offsets show up under /tmp/kafka-logs and doesn't show up in zookeeper ephemeral nodes?

Upvotes: 1

Views: 452

Answers (1)

Gary Russell
Gary Russell

Reputation: 174769

Spring Kafka uses the "new" consumer (Java) not the old scala consumer.

Upvotes: 1

Related Questions