Jeremy
Jeremy

Reputation: 1

Where is the documentation of ARM / Terraform for Azure Synapse Pipeline, Spark Job Definition etc

I want to deploy a Synapse pipeline which contains a Spark Job definition, activities etc. with an terraform script or an ARM template. But i don't find any documentation for this. I found for data factory pipeline : https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs/resources/data_factory_pipeline but not equivalent documentation for Synapse.

Same issue with ARM documentation (https://learn.microsoft.com/fr-fr/azure/templates/).

I don't want to use the Workspace of Azure Synapse.

Is the documentation available ?

Thanks for your support

Upvotes: 0

Views: 721

Answers (2)

Dholmgren
Dholmgren

Reputation: 19

I don't think this documentation exist (after some Microsoft Docs scouting).

You can create the pipelines and spark job definition in the Workspace and then click on the 'Publish'-button. If you have GIT-integration, this will generate an ARM Template in your GIT repo under the branch 'workspace_publish' (default value). With this ARM you can see how Synapse Workspace creates the ARM for pipelines and spark job definitions and then reuse the same pattern/syntax.

Upvotes: 0

Related Questions