CODEWITHSUNDEEP
salesforceapache-kafka-connectaws-msk
austiine
austiine

Reputation: 480

Does kafka salesforce-bulk-source-connector work with Amazon MSK?

happy new am experimenting with Kafka for the first time, i set up an AWS MSK Kafka cluster successfully, next step in my experiment is the using kafka-connect and in particular i want to use the salesforce-bulk-source connector, according to the documentation its say that this connector is a proprietary connector and it requires a confluent license as part of the configuration as well as a topic where to store here the confluent platform configuration, my question, does this connector work with an MSK cluster or would it require my cluster to be on the confluent platform?

Upvotes: 1

Views: 864

Answers (1)

Robin Moffatt
Robin Moffatt

Reputation: 32110

You can use the connector regardless of your Kafka cluster. You will need to run your own Kafka Connect worker, configured to use your Kafka cluster.

As you have noted, it is a proprietary connector and therefore:

  • You can use it with a 30-day free trial
  • or under the Developer Licence indefinitely if you have just a single Kafka broker

Here's an example of a Docker Compose to run Kafka Connect docker image.

Edit: You cannot use Confluent connectors that require a commercial license with MSK. You need a valid Confluent subscription.

Upvotes: 3

Related Questions