CODEWITHSUNDEEP
azureazure-data-factory
Cedersved
Cedersved

Reputation: 1025

Where is the compression happening with Azure Data Factory?

If you have a pipeline with a copy data activity, which copies data from an on-prem SQL server to an azure data lake storage account - and you choose some form of compression.

Where is the compression happening? Is the data transfered over the internet to the cloud, and then compressed. Or does it get compressed on-prem by the self-hosted integration runtime?

Upvotes: 0

Views: 395

Answers (1)

David Browne - Microsoft
David Browne - Microsoft

Reputation: 89371

Where is the compression happening?

The compression happens on the self-hosted Integration Runtime.

If it is a staged copy, the IR will compress the data when writing to the intermediate blob storage account. And if it's not a staged copy, the IR writes the files directly to ADLS.

Upvotes: 2

Related Questions