CODEWITHSUNDEEP
azureazure-data-factory
Aritra Sarkar
Aritra Sarkar

Reputation: 225

Limitation of an Azure Data Factory Web Activity to read JSON file from Azure Blob

I'm having a JSON file in the Azure Blob Storage. My aim is to read the contents of the JSON file using a Web Activity and pass the response to the body of the next Web Activity.

At the moment, the JSON file in the Blob storage is having couple of rows, and the pipeline is running successfully, achieving the goal.

My question is: Is there a limitation to the Web Activity to read only n number of rows from a file? Like, I mean, we know that the limitation of a Lookup Activity is that, it can only read 5000 rows. Is there any similar sort of limitation while reading using a Web Activity?

What if, JSON file in the Blob storage is having 500000 or even more number of rows? Will the Web Activity be able to read all the rows from the JSON file?

Thanks in advance :)

Upvotes: 0

Views: 967

Answers (1)

GregGalloway
GregGalloway

Reputation: 11625

Please see the documentation for Web Activity and notice the note at the top:

Note

The maximum supported output response payload size is 4 MB.

I would recommend you vote for this feature request or here.

Upvotes: 1

Related Questions