CODEWITHSUNDEEP
azure-data-factory
Phil Lachmann
Phil Lachmann

Reputation: 231

Azure Data Factory - Data Flow - Set Variable

Within my pipeline I have a small data flow activity that reads a value out of a JSON file that I would like to use back in the main flow.

From withing the data flow I would like to set a variable with this value, however I've not found a way to do that.

So how do I set a variable with a new value from within a 'data flow' ??

Upvotes: 0

Views: 3631

Answers (2)

virtualdvid
virtualdvid

Reputation: 2421

Now we can set values in a dataflow without the need of using sink to load a file in Blob store and using extra activities to read it. Check Cached lookup documentation:

Cache Sink
Cached lookup

In the Sink we can select Cache instead of Dataset...

Then we can use that value in any of the other activities:

like mySinkName#outputs()[myRowNumber].myColumnName

Upvotes: 1

Mark Kromer MSFT
Mark Kromer MSFT

Reputation: 3838

Every data flow activity needs to have a Sink. Sink that data value from your data flow results into a destination store (i.e. Blob store). You can then read that value from your data flow in a subsequent Lookup activity to load it into a pipeline variable.

Upvotes: 1

Related Questions