CODEWITHSUNDEEP
azuredata-warehouseazure-synapse
greenglas
greenglas

Reputation: 29

Is Azure Synapse Link a good way of loading the data in a Data Warehouse?

Azure Synapse Analytics is the datawarehouse solution from Azure.

There are 3 ways to load the data into the warehouse:

  1. COPY statement

  2. PolyBase

  3. Bulk insert

The fastest and most scalable way to load data is through the COPY statement or the PolyBase.

However now it is also possible to load the data through Synapse Links. Which allows near-real time data.

But I do not see any documentation referring to Synapse Links being used in a traditional Data Warehouse for analytics.

The use cases in the documentation are:

Which are use cases that need real time data.

I do not need near real time data. Therefore I assume "Synapse Link" has some disadvantages for a traditional data warehouse solution.

Could someone please tell me their knowledge about using "Synapse Link" in a traditional analytics data warehouse ?

Thanks in advance

Upvotes: 0

Views: 662

Answers (1)

Bernardo
Bernardo

Reputation: 38

With "Traditional datawarehouse solution" I assume you have ETL processes, that load/refresh your DWH say once a day.

The Synapse Link is a very convenient way to import Cosmos DB or Dataverse Data into a Data Lake connected to Synapse. The "real time" part of it shouldn't bother you, because you can always use batch jobs (dataflows) to load the data periodically from the lake into your datawarehouse.

With the Synapse Link you save time and development effort to bring the data properly from the Cosmos DB or Dataverse into your analytical environment. It works great for us.

Upvotes: 1

Related Questions