CODEWITHSUNDEEP
azureazure-data-lakedata-migrationazure-data-factory
Dataholic
Dataholic

Reputation: 123

How to migrate data (folders) from a server on a local private network to azure data lake?

I have a server located on a local secured network. I want to migrate the data periodically from this server to Azure data lake 2.0.

I tried using data factory, but was unsuccessful. Any recommendation would be appreciated.

Upvotes: 1

Views: 40

Answers (1)

mmarie
mmarie

Reputation: 5638

Azure Data Factory should be fine for this, but you need to use a self-hosted integration runtime. You would set up a linked service of type file system that uses the self-hosted IR as your source linked service. Then set up a linked service for ALDS Gen 2 to use for your destination. You can copy multiple files at once and preserve the folder hierarchy by making sure the copy behavior is set to PreserveHierarchy. You can find more information, including how to set your datasets and copy activity in Microsoft Docs.

Upvotes: 2

Related Questions