CODEWITHSUNDEEP
azure-data-factory
Gagan
Gagan

Reputation: 1913

Python REST API in Azure Data factory

I have an extra API which I need to access using my Python REST client (OAuth and tokens are everything sorted). But I would like to invoke this python client in my Data Factory as I want to store the results into Azure SQL warehouse.

Any help on how to do it?

Upvotes: 1

Views: 1790

Answers (1)

Martin Esteban Zurita
Martin Esteban Zurita

Reputation: 3209

What you want is a custom activity, this way you can run a Python script with Data Factory. For this you need to create an extra resource, Azure Batch.

More info here: https://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-dotnet-custom-activity and here https://learn.microsoft.com/en-us/azure/batch/batch-python-tutorial#batch-python-tutorial-code-sample

If you dont like that option, you can use a Web activity, that also calls a custom REST api. Documentation: https://learn.microsoft.com/en-us/azure/data-factory/control-flow-web-activity

Hope this helped!

Upvotes: 1

Related Questions