CODEWITHSUNDEEP
apache-kafka
Ajey kumar HB
Ajey kumar HB

Reputation: 11

KAFKA partition data achieving data dailywise

Is it possible in Kafka to archive data daily-wise to some directory?
Also let me know is it possible to create a partition on a daily base.

Upvotes: 0

Views: 71

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191864

You can use Kafka Connect with the DailyPartitioner class in Confluent's connectors to backup topic data to HDFS or S3

There's also FileSink connectors for local disk out of the box with Kafka, but you might need to implement the partitioner yourself

Upvotes: 1

Related Questions