CODEWITHSUNDEEP
amazon-s3apache-kafkaapache-kafka-connect
Marcos Peralta
Marcos Peralta

Reputation: 129

How to send data to AWS S3 from Kafka using Kakfa Connect without Confluent?

I have a local instance of Apache Kafka 2.0.0 , it running very well. In my test I produce and consume data from twitter and put them in a specific topic twitter_tweets and everything is OK. But now I want to consume the topic twitter_tweets with Kafka Connect using de connector Kafka Connect S3 and obviusly store the data in AWS S3 without using Confluent-CLI.

Can I do this without Confluent? Anyone have an example or something to help me?

Upvotes: 0

Views: 1062

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191738

without Confluent

S3 Sink is open source; so is Apache Kafka Connect.

Connect framework is not specific to Confluent

You may use Kafka Connect Docker image, for example, or you may use confluent-hub to install S3 Connect on your own Kafka Connect installation.

Upvotes: 1

Related Questions