CODEWITHSUNDEEP
talend
wz 98
wz 98

Reputation: 93

Load multiple multischema delimited file from same directories

Could I know does it have any method to load multiple files that are multi schema delimited files which store in same directories in Talend?

I have tried use the tFileInputMSDelimited component before, but unable to link with tFilelist component to loop through the files inside the directory.

Does anyone have idea how to solve this problem?

To make clearer, each file only contain one batch line but contain multiple header line and it comes with a bunch of transaction line. As showing at the sample data below.

enter image description here

enter image description here

Upvotes: 0

Views: 438

Answers (1)

Carassus
Carassus

Reputation: 142

The component tFileOutputMSDelimited should suit your needs.

You will need multiple flows going into it. You can either keep the files and read them or use tHashInput/tHashOutput to get the data directly.

Then you direct all the flows to the tFileOutputMSDelimited (example with tFixedFlowInput, adapt with your flows) :

Example with tFixedFlowInput

In it, you can configure which flow is the parent flow containing your ID. Then you can add the children flows and define the parent and the ID to recognize the rows in the parent flow :

tFileOutputMSDelimited config

Upvotes: 1

Related Questions