CODEWITHSUNDEEP
azure-data-factory
Ganesh Anthati
Ganesh Anthati

Reputation: 65

use adf pipeline parameters as source to sink columns while mapping

I have an ADF pipeline with copy activity, I'm copying data from blob storage CSV file to SQL database, this is working as expected. I need to map Name of the CSV file (this coming from pipeline parameters) and save it in the destination table. I'm wondering if there is a way to map parameters to destination columns.

Upvotes: 2

Views: 3849

Answers (2)

Miroslaw
Miroslaw

Reputation: 231

In DF v2 in Copy Data activity, it is possible to add a new column to the source with value $$FILEPATH, and then each record will have a name of the input file.

Azure DF v2, CopyData activity -> Source CopyData activity -> Source

Upvotes: 0

Yusheng
Yusheng

Reputation: 221

Column name can't directly use parameters. But you can use parameter for the whole structure property in dataset and columnMappings property in copy activity. This might be a little tedious as you will need to write the whole structure array and columnMappings on your own and pass them as parameters into pipeline.

Upvotes: 1

Related Questions