CODEWITHSUNDEEP
apache-kafkakafka-consumer-apikafka-producer-api
Raman Mishra
Raman Mishra

Reputation: 2686

Is it possible to see the data partition wise in a kafka topic?

I have start working with Kafka few days ago. I am using Kafka on Windows environments, I want to see the data in each partition of a Kafka topic.

I have a topic called ExampleTopic with replication.factor set to 3 and 3 partitions. I am able to see the data into the topic but I want to see which messages are going in which partitions.

Please let me know is it possible if yes then how?

Upvotes: 1

Views: 4326

Answers (3)

Raman Mishra
Raman Mishra

Reputation: 2686

I have got an GUI based tool to view data in each partition of a topic named kafka tool. http://www.kafkatool.com It’s a tool to manage our kafka cluster. Also provide many features should try.

Upvotes: 2

vahid
vahid

Reputation: 1218

You can use the --partition parameter of the Kafka console consumer to specify which partition to consume from: bin\windows\kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic ExampleTopic --partition 0 You can also specify an --offset parameter that indicates which offset to start from. If absent, the consumption starts at the end of the partition.

Upvotes: 3

Robin Moffatt
Robin Moffatt

Reputation: 32100

Use kafkacat, e.g. : 

$ kafkacat -b localhost:9092 -t my_topic -C \
-f '\nKey (%K bytes): %k\t\nValue (%S bytes): %s\n\
Timestamp: %T\tPartition: %p\tOffset: %o\n--\n'

Key (1 bytes): 1
Value (79 bytes): {"uid":1,"name":"Cliff","locale":"en_US","address_city":"St Louis","elite":"P"}
Timestamp: 1520618381093        Partition: 0    Offset: 0

Upvotes: 1

Related Questions