CODEWITHSUNDEEP
azure-data-factory
Vidya Sagar
Vidya Sagar

Reputation: 31

Multi-character column delimiter not supported in ADF connection

My text file has a delimiter with 2 characters (~*).

However ADF supports column delimiters with only one chararacter. Any help or workaround?

It is a text file present in Azure blob storage which needs to be imported to SQL database.

Screenshot here

Upvotes: 3

Views: 1881

Answers (2)

Trent Tamura
Trent Tamura

Reputation: 1145

As of Dec 4th 2021, ADF now has the option for a multiple character delimiter on a copy data activity:

ADF Enhancement

See below example for where delimiter goes:

Dataset Example CSV

Upvotes: 1

saul
saul

Reputation: 979

One workaround would be to go with U-SQL scripts, there you can use any delimiter, I usually prefer non-printable characters like "\u0001", for instance I use this as a column delimiter in most of my Azure Data Analytics U-SQL Scripts, and you can run the U-SQL script from ADF.

Update

I ended up using the Start of Heading character (\u0001), in fact it is one of the options available in the UI and it's been working so far, there are still some bugs with other delimiters like ('¬') but MS is working on that.

enter image description here

Upvotes: 0

Related Questions