CODEWITHSUNDEEP
azure-data-factory
code_hr
code_hr

Reputation: 21

Amazon S3 sink option is Disabled in Azure DataFlow. How to enable it?

I am creating a new DataFlow in Azure Data Factory. I want to read a filestream column from sql server and upload it to S3 bucket for POC purpose.

I created Azure DataFlow, Added Amzaon S3 Linked Service and Verified the connection. Now, Amazon S3 option is available for Selecting Source but I need to set it into Sink. When I add a new Sink then Amazon S3 option is disabled there (see screenshot).

Screenshot

Upvotes: 0

Views: 1136

Answers (1)

Naveen Sharma
Naveen Sharma

Reputation: 1268

As per the Documentation, Currently Amazon S3 is only supported as Source and not as sink in ADF dataflow.

You can raise the feature request for that here.

As an alternative, you can try copying the data using other services like databricks or functions by configuring the connections.

Or If you can connect your Amazon SFTP to s3 bucket to copy the data to it, you can try the below method.

Transform the input data to amazon sftp first. Then use this as per your requirement to copy the data to your S3 bucket. In the sink of the dataflow, use sftp dataset.

enter image description here

Go through this blob by @Sena Yakut to learn about getting files from aws sftp to S3.

Upvotes: 0

Related Questions