chetan parab
chetan parab

Reputation: 1

Want to Ignore Comma(,) in ADF as delimiter

Have text tab delimited file which I'm converting into csv in ADF In which, some field having comma separated values ( Don't want to split into columns) -> want to treat it as single column But in ADF trying to separate those values into multiple column Although, I have set a delimiter as "TAB(\t)", still ADF taking Comma and tab both as delimiter why?

tab delimited file ex

As you can see in the above Ex, I want to split this on basis of '\t' delimiter but ADF considering 'tab' as well as 'comma' as a delimiter(Want to treat [pp,aa] as single value/column)

Any solution? plz let me know. Thank you Attaching ADF conf as well. ADF CONF

Upvotes: 0

Views: 1578

Answers (1)

NiharikaMoola
NiharikaMoola

Reputation: 5074

Set the quote character to a single character instead of "No quote character" in source and sink datasets.

I tried with the sample and was able to get the data as expected.

Source:

enter image description here

Source Dataset:

enter image description here

Sink Dataset:

enter image description here

output:

enter image description here

Reference - Dataset Properties

Property Description
quoteChar The single character to quote column values if it contains column delimiter. The default value is double quotes ".
escapeChar The single character to escape quotes inside a quoted value. The default value is backslash \.

Upvotes: 2

Related Questions