CODEWITHSUNDEEP
apache-kafkaconsumer
Luan Hongjun
Luan Hongjun

Reputation: 21

My app's kafka consumer group disappears

I've encountered a strange problem. I write a consumer with python to get data from kafka.

self.consumer = KafkaConsumer(self.kafkatopic,
                group_id=self.groupid,bootstrap_servers=self.kafkaservers, 
auto_offset_reset="earliest")
for message in self.consumer:
     messageText = message.value

It runs successfully for about one day. But one day later I couldn't find my consumer group from runing:

./kafka-consumer-groups.sh --bootstrap-server 127.0.0.1:9092 --list

My python process is still running. I try tcpdump and find that the app is still trying to connect kafka. But no data responsed. Could anyone help me?

Upvotes: 1

Views: 792

Answers (1)

Luan Hongjun
Luan Hongjun

Reputation: 21

I think the problem is caused by version difference. My python kafka sdk's version is lower than kafka's version I re-impl the logic with java. And java kafka sdk's version equals to kafka's. Then the problem is resolved.

Upvotes: 1

Related Questions