CODEWITHSUNDEEP
azure-data-factory
Toni Vukasinovic
Toni Vukasinovic

Reputation: 67

Resolving error StatusCode":"DFExecutorUserError" 1204

I have a dataflow that joins (by unique ID) 2 tables which are big (around 20 million rows each) and then stores them into a new table. The pipeline just runs the dataflow mentioned and the settings are maxed out (256 cores as it is a lot of data). But for some reason i get the error mentioned, is there a way to fix this?

enter image description here

Upvotes: 0

Views: 1305

Answers (1)

Abhishek Khandave
Abhishek Khandave

Reputation: 3240

As suggested here by Leon Yue, this error can be resolved by increasing number of cores. But as you mentioned, you already have 256 cores.

You can try below 2 workarounds.

  1. You need to check compute type of Integration Runtime, it should be compute optimized.

  2. Create different Integration Runtimes for debug and prod.

For more information you can go through this video.

Upvotes: 1

Related Questions