CODEWITHSUNDEEP
azureazure-sql-databaseazure-data-factory
Peter Morris
Peter Morris

Reputation: 23224

Near real-time ETL of Oracle data to Azure SQL

I have an Oracle DB with data that I need to load and transform into an Azure SQL Database. I have no control over either the DB nor the application that updates its data.

I'm looking at Azure Data Factory, but I really need data changes in Oracle to be reflected as near to real-time as possible.

I would appreciate any suggestions / insights.

Is ADF the correct tool for the job? If so, what is a good approach to use? If not suitable, what should I consider using instead?

Upvotes: 0

Views: 2966

Answers (3)

Peter Morris
Peter Morris

Reputation: 23224

For the record, we went with a product named QLik Replicate (aka Attunity) and it is working very well!

Upvotes: 0

wBob
wBob

Reputation: 14389

For real-time you don't really want an ELT/ETL tool like ADF. Consider a replication agent like Attunity or (gulp at the licensing costs) GoldenGate.

Upvotes: 1

Leon Yue
Leon Yue

Reputation: 16431

I don't think Data Factory is not good for you. Yes you can copy data from Oracle to Azure SQL database with it. But like @Thiago Custodio said, we need need to do it to each table you have. That's too complicated.

Just reference: Copy data from and to Oracle by using Azure Data Factory.

As you said, you really need data changes in Oracle to be reflected as near to real-time as possible.

The migration/copy time must be very short. Then the data in Oracle and Azure SQL database could be same before the Oracle data changed next time. I searched a lot and didn't find any real-time copy tools. Actually, I think you want the copy could be something like 'data sync'.

I found this link Sync Oracle Database with SQL Azure, hope it could give some good ideas for you.

About the data migration or copy, You can using bellow ways:

  1. SQL Server Migration Assistant for Oracle (OracleToSQL)
  2. Azure Database Migration Service (DMS)

Reference tutorial:

  1. Migrating Oracle Databases to SQL Server (OracleToSQL): SQL Server Migration Assistant (SSMA) for Oracle is a comprehensive environment that helps you quickly migrate Oracle databases to Azure SQL database.
  2. How to migrate Oracle to Azure SQL Database with minimum downtime:

Hope this helps.

Upvotes: 1

Related Questions