quervernetzt
quervernetzt

Reputation: 11661

Azure Data Factory: Deduplicate array

I have an Azure Data Factory pipeline with an array as parameter with potentially duplicate (simple string) values.

How can I remove the duplicates from the array without using a custom activity?

Upvotes: 0

Views: 830

Answers (1)

quervernetzt
quervernetzt

Reputation: 11661

I defined a variable of type array and applied a union on the parameter itself. This removes the duplicate values.

Like @union(pipeline().parameters.FilePaths,pipeline().parameters.FilePaths).

Upvotes: 1

Related Questions