CODEWITHSUNDEEP
azure-data-factory
user3843858
user3843858

Reputation: 331

Dynamically Assign Source column in import schema "expression" in Azure Data Factory using Lookup activity

i am new in azure data factory V2

i have schema file-

CustomerSchema.csv

Data-in CSV File

CustomerId, CustomerName, CustomerAddress

Actual Data File in CSV Formatoe FileName-CustomerMaster.CSV, data below

101,Aphilps,R-z1 west loan usa
102,Jons s,202-3 sest road  london
103,Ravi,Old Madaras banglore
104,n Har,hi road -203 banglore
105,Jons K,West-23-34 new york usa

Target File with Schema CustomerTraget.CSV

CustomerId, CustomerName, CustomerAddress ----Blank no Data

i have pipline where first activity is lookup activity that bring schema from file CustomerSchema.CSV

output of lookup activity is correct, it's fetch 3 Columns name

enter image description here

Now how i passed output of lookup activity in my copy activity import schema expression

i have try below but not work

@activity('ColumnLookup').output.firstRow in schema expression but it's not working

please help me

Upvotes: 1

Views: 2137

Answers (1)

Bo Xiao
Bo Xiao

Reputation: 816

Parameterized schema or mapping should follow this pattern:

column mapping:

{
    "type": "TabularTranslator",
    "columnMappings": 
    {
        "UserId": "MyUserId",
        "Group": "MyGroup",
        "Name": "MyName"
     }
}

schema:

[
    { "name": "UserId"},
    { "name": "Name"},
    { "name": "Group"}
]

ref : https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-schema-and-type-mapping

Upvotes: 1

Related Questions