Mohammad
Mohammad

Reputation: 1013

How to define schema when copying Excel file with several sheet with different schema?

I am going to use a Copy activity in ADF to copy excel files from ADLS to Synapse Data Warehouse.

Excel file has several sheets with different column names and schema. A list of excel sheets are passed to the ADF pipeline as a parameter to be processed.

How can I define different Schemas in Dataset object in ADF in this scenario?

Background:

When I trigger Copy activity without defining or mapping Schema, I encounter the below error:

ErrorCode=DelimitedTextColumnNameNotAllowNull,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The name of column index 1 is empty. Make sure column name is properly specified in the header row.,Source=Microsoft.DataTransfer.Common

I searched about this error and checked the source file:

As a potential solution, I am going to define schema for the excel sheets given that every excel sheet has a different schema.

Upvotes: 0

Views: 31

Answers (0)

Related Questions