CODEWITHSUNDEEP
azureazure-devopsazure-data-factoryazure-databricks
AmitG
AmitG

Reputation: 609

Configure Azure DevOps repository in Databricks through ARM template or Powershell

I am looking for a sample ARM template which can setup my Azure DevOps repository into Azure Databricks. This will help me deploy my Master branch directly on ADB workspace.

I tried to do manually on portal and it works, but the repos path for the notebooks shows my email_id, which is not good in Production.

I want to configure through a Powershell OR an ARM template while creating Databricks. The same problem I am facing on Azure dataFactory as well.

Please help me resolve it.

Upvotes: 2

Views: 1439

Answers (2)

Axel R.
Axel R.

Reputation: 1300

To deploy Notebooks from your master branch to another workspace, I would recommend to trigger a deployment pipeline from the master branch onto the target databricks worskpace. That way, no need to setup Repos in the target environment.

  1. You use Repos in your development workspace (with your email in path)

  2. You commit to the branch you work on and eventually merge / PR to master

  3. Once on Master branch, a DevOps pipeline is triggered and deploys the notebook to your target workspace on the path you want

enter image description here

Upvotes: 0

Alex Ott
Alex Ott

Reputation: 87279

It's not possible as of today - there is no API for creating a checkout. It will be possible only when Databricks Repos will start to provide corresponding API for creating the checkouts of repositories, not only "Update checkout" API that is available right now.

If you're concerned with the checkout created in your own folder, you can just create a Folder inside Repos, call it like "Production", and then do checkout inside that folder (pictures are taken from my demo of Repos with Azure DevOps):

create a folder

checkout the project into folder

Upvotes: 1

Related Questions