CODEWITHSUNDEEP
sqlsql-server-2008queueapache-kafkaservice-broker
user4378537
user4378537

Reputation:

Integrating Kafka and sql server 2008

I have a SQL 2008 R2 database that i would like to integrate with Kafka so essentially I want to use Change data capture to capture changes in my table and put them on a Kafka Queue - this is for the front end Devs to read the data off Kafka. Has anyone done this before or have any tips on how to go about it?

Upvotes: 2

Views: 2525

Answers (2)

Randy Burden
Randy Burden

Reputation: 2661

Kafka Connectors will solve this problem now in particular the JDBC connector.

The JDBC connector allows you to import data from any relational database with a JDBC driver into Kafka topics. By using JDBC, this connector can support a wide variety of databases without requiring custom code for each one.

Source: http://docs.confluent.io/3.0.0/connect/connect-jdbc/docs/jdbc_connector.html

See also:

Kafka Connect JDBC Connector source code on GitHub

Kafka Connect Documentation

Upvotes: 2

Nadeem
Nadeem

Reputation: 324

There is no way you can do it directly from Sql server. You have to write your own producer that will pull day from Sql, and push to Kafka queue. We are currently doing the same thing via background services that pushed data to Kafka

Upvotes: 0

Related Questions