CODEWITHSUNDEEP
azureazure-data-factory
Arunachalam
Arunachalam

Reputation: 47

Continuous integration and Continuous deployment in Azure Data factory

I want to do continuous integration and deployment in Azure Data factory. I'm not able to find any specific document explaining this.

How can I do it or where can I read about it?

Upvotes: 2

Views: 393

Answers (2)

Gaurav Malhotra
Gaurav Malhotra

Reputation: 71

You can use the VSTS GIT integration with ADF v2 UX to do continous deployment and continuous integration. VSTS GIT integration allows you to choose a feature/development branch or create a new one in your VSTS GIT repo. You can work in your feature/development branch and create PR in VSTS GIT to merge your changes to the master branch. You can then publish to your data factory using ADF v2 UX. Please try this and let us know if this doesn't work for you or you face any issues.

Upvotes: 0

arghtype
arghtype

Reputation: 4534

To build your project, you can use msbuild - just like it's done in Visual Studio. It will validate syntax, check references between json configurations and check all dependencies. If you are using Visual Studio Team Services as CI server you can use Visual Studio Build step in build configuration to do it. However, it requires to install ADF tools for VS on build agent machine.

To deploy, you can try:

  1. Powershell. For example, you can use Set-AzureRmDataFactoryV2Dataset to deploy datasets. There are similar commands for all other configurations and for version 1 of Azure Data Factory as well.
  2. If you are using VSTS, you can try this 3rd party extension. It allows to deploy json configurations and start/pause pipelines. I'm not sure if it works with ADF v2.

Upvotes: 1

Related Questions