aspilond
aspilond

Reputation: 11

Export data from Kafka to Oracle

I am trying to export data from Kafka to Oracle db. I've searched related questions and web but could not understand that we need a platform (confluent etc.. ) or not. I'd been read the link below but it's not clear enough.
https://docs.confluent.io/3.2.2/connect/connect-jdbc/docs/sink_connector.html
So, what we actually need to export data without 3rd party platform?

Thanks in advance.

Upvotes: 0

Views: 799

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191725

It's not clear what you mean by "third-party" here

What you linked to is Kafka Connect, which is Apache 2.0 Licensed and open source.

Kafka Connect is a plugin ecosystem, you install connectors individually, written by anyone, or write your own, just like any other Java dependency (i.e. a third-party)

The JDBC connector just happens to be maintained by Confluent. and you can configure the Confluent Hub CLI to install within any Kafka Connect distribution (or use Kafka Connect Docker images from Confluent)


Alternatively, you use Apache Spark, Flink, Nifi, and many other Kafka Consumer libraries to read data and then start an Oracle transaction per record batch

Or you can explore non-JVM kafka libraries as well and use a language you're more familiar with doing Oracle operations with

Upvotes: 2

Related Questions