CODEWITHSUNDEEP
azureazure-data-factoryazure-data-lakeazure-synapsepolybase
Ben
Ben

Reputation: 11

Keep staging Blobs in Data Lake after copy activity

I've been copying date into Synapse using the copy data functionality in Azure data factory (polybase), with staging enabled to stage the data in our azure data lake. However, once the copy into Synapse is complete the staging files in our azure data lake get deleted.

Is there any way to keep the staged files in the data lake after the copy activity has finished, rather than deleting?

Upvotes: 1

Views: 743

Answers (1)

Pratik Lad
Pratik Lad

Reputation: 8402

As per the document, the staged data gets cleaned up after the data movement to the sink is completed.

Copy activity performance optimization features - Azure Data Factory & Azure Synapse | Microsoft Docs

If you want to copy data to data lake storage, you can use other copy activity and store the data in data lake storage as sink data store.

Upvotes: 0

Related Questions