Abhinav Kumar
Abhinav Kumar

Reputation: 240

Apache Kafka Connect VS Confluent connector

What is the difference between using Apache Kafka Connect API and Confluent Kafka Connect API ?

Upvotes: 0

Views: 1757

Answers (1)

sramu
sramu

Reputation: 1091

As mike mentioned, there is no core difference between Apache kafka connect and confluent kafka connect.


As an example of using JDBC Connector plugin from Confluent with MySQL database to read data from MySQL and send it to kafka topic.

For a quick demo on your laptop, follow below main steps:

  1. Download Apache Kafka (from either Apache site, or you can download Confluent Platform)
  2. Run single Kafka broker using kafka-server-start script.
  3. Download kafka-connect-jdbc from Confluent Hub
  4. Edit plugin.path in connect-standalone.properties to include the full path to extracted kafka-connect-jdbc files.
  5. Download and copy mysql driver into kafka-connect-jdbc folder with other JARs (you should see sqlite JAR is already there)
  6. create jdbc source connector configuration file
  7. run Kafka connect in standalone mode with jdbc source connector configuration

$KAFKA_HOME/bin/connect-standalone.sh ../config/connect-standalone.properties ../config/jdbc-connector-config.properties

Useful links

https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/ https://docs.confluent.io/current/connect/kafka-connect-jdbc/index.html

If you want to write code, then learn kafka producer api usage. https://docs.confluent.io/current/clients/producer.html https://kafka.apache.org/documentation/#producerapi

Upvotes: 1

Related Questions