CODEWITHSUNDEEP
azuremigrationazure-data-factoryazure-data-lakedata-migration
Dataholic
Dataholic

Reputation: 123

How can I migrate zipped folders located on-premises FTP server to Azure storage?

I have a zipped folder which have several sub folders and each sub-folders have many files in it. Some files are binary files, some are csv and some are plain text. My requirement is to copy the zip folder, as it is without unzipping it at the on-premise FTP sever, to Microsoft Azure cloud. And this process is not one time but on a regular basis copy whenever a new zip files comes into FTP server.

Upvotes: 0

Views: 314

Answers (1)

Leon Yue
Leon Yue

Reputation: 16431

Please ref this tutorial: Copy data from FTP server by using Azure Data Factory

For example, my zipped file has sub folders and each sub-folders have different files: enter image description here

Using Binary format as Source dataset, choose the Commpression type: ZipDeflate:

Source dataset:

enter image description here

Sink dataset: enter image description here

This can achieve the zipped folder copy.

For you purpose, you want to trigger the pipeline when a new zip file is added to into FTP server. Just For Data Factory, the event trigger doesn't support FTP Server. We can't do that.

I think you could achieve that with a Logic app through FTP trigger: When a file is added or modified (properties only) trigger.

enter image description here

Pass the new add zip file name as Data Factor pipeline parameter, and run the pipeline.

Upvotes: 1

Related Questions