CODEWITHSUNDEEP
azure-databricksazure-data-factorydelta-lake
Ramkumar
Ramkumar

Reputation: 75

copy data from on premise sql server to delta format in Azure Data Lake Storage Gen2

I have a copy activity that copy on premise sql data to parquet format in data lake gen2. But I need to copy sql data to delta format in the same data lake. I tried using the data flow to copy from parquet to delta but we have performance issues in this approach. Is there any other way we can achieve this?

Upvotes: 0

Views: 1838

Answers (1)

Sairam Tadepalli
Sairam Tadepalli

Reputation: 1683

We have different tools to accomplish the required task.

  1. The Copy Data tool
  2. The Azure portal
  3. The .NET SDK
  4. The Python SDK
  5. Azure PowerShell
  6. The REST API
  7. The Azure Resource Manager template

The major requirement is to make perfect configuration regarding access tokens and authentication.

https://learn.microsoft.com/en-us/azure/data-factory/connector-azure-databricks-delta-lake?tabs=data-factory

Check the above link for the procedure.

Upvotes: -1

Related Questions