CODEWITHSUNDEEP
azuresharepointazure-data-factorysharepoint-onlineazure-synapse
sthambi
sthambi

Reputation: 257

Copying files from Sharepoint to Azure Data lake gen 2 using Azure Synapse

I am trying to copy files from Sharepoint to Azure data lake gen2 using Azure Synapse pipeline

I have set up the prerequisites and configured the pipeline as mentioned in the document (https://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-factory#copy-file-from-sharepoint-online)

Web succeeds and passes a token to the Copy Data activity. However, I am getting the error in the sink side

enter image description here

Getting below error message

enter image description here

Not sure what is the issue? can anyone advise? I referred various posts but no success

Upvotes: 0

Views: 5759

Answers (2)

Dimitri Syntera
Dimitri Syntera

Reputation: 1

A few weeks ago I ran into the same problem following the same documentation.

I was able to solve the problem by enabling Custom App Authentication. For SPO tenants that were created after 07.11.2018 the authentication via ACS app-only access token is disabled by default (see blue box in link below).

Granting access using SharePoint App-Only

I decided to write a blog post with a step by step guide on how to move multiple files from an SPO folder to Blob Storage using Azure Data Factory, maybe you will find it usefull:

Copy files from SharePoint to Blob Storage

Upvotes: 0

Abhishek Khandave
Abhishek Khandave

Reputation: 3228

Error – The remote server returned an error: (401) Unauthorized.

This error occurs because of authentication issue.

This operation requires SharePoint Online site owner permission. You can find the owner by going to the site home page -> click the "X members" in the right corner -> check who has the "Owner" role.

Also check

Even if an Azure AD application has FullControl permissions on SharePoint Online, you can't copy files from document libraries with IRM enabled.

Refer - https://learn.microsoft.com/en-us/answers/questions/381621/copy-data-from-sharepoint-using-adf-1.html

Upvotes: 0

Related Questions