save the output of 'Set Variable' activity into a csv file [Azure Data Factory]

Azure Data Factory: I´m trying to save some variables (messages as: pipeline error, pipeline success and pipeline date end) from ´set variable´ into a csv file on my blobstorage. I created a table in blob storage and now i need to fill table rows with this informations from ´set variable´. At the end of the pipeline I´ll use Logic App to generate a PDF report.

enter image description here

Upvotes: 1

Views: 2513

Answers (1)

Sally Dabbah
Sally Dabbah

Reputation: 479

You can use your variable as a data source in the copy activity and then you can set the sink to be a csv file/ blob storage/ ADLS etc.

i built a quick Demo :

SaveDataFromSetVariableActivity

Here , i saved the data in a set variable activity into a variable and i named it "data" , in the copyData activity ,i chose the source to be a json (because my data is a json array , u can change it to csv if your data is csv) after that i clicked on : File Path Type -> List Of Files -> Path to File List -> @variables("data")

Question :

Why you're using a csv to describe your pipeline status ? why not just a simple json ? it will be easier to parse + understand the data in a json format.

Upvotes: 0

Related Questions