CODEWITHSUNDEEP
azureazure-data-factory
Akhilesh Balakrishnan
Akhilesh Balakrishnan

Reputation: 93

Unchanged Azure Dataflow Shows Validation Error On Flow Expression

We were trying to copy and transform data from one cosmos collection to another using data flows. We are using query to select the data from the collection, all of a sudden the data factory show validation error:

Data flow expression uses functions/parameters/columns which are not present in current context

when the validate all option is selected.

We did not make any modifications and nothing published this occurred. Also when we try to debug it shows the same error.

How should this be resolved?

Upvotes: 2

Views: 4520

Answers (2)

joelforsyth
joelforsyth

Reputation: 1021

I don't know if you're still having this issue, but for the people coming here in the future the issue is resolved by importing the schema on the step before the filter/select.

  1. Start Debug session

  2. Select the Source > Projection > Import Projection

This will update the schema to allow for your query to view the column

Upvotes: 1

chethan konduru
chethan konduru

Reputation: 91

Yes i have faced this error before @Akhilesh.

  1. Check if the query you have used is valid.
  2. Check all the input fields within the dataflow transformation if there is any field highlighted in red.
  3. If above doesnt work, then delete and create a new dataflow and add your expressions or queries without any errors. Validate everytime you add any transformation to get a clear answer where you are making the error.

Debug will not run if you have any invalid fields within the dataflow. There might be any expression field which is invalid and hence u r getting validation error.

Upvotes: 1

Related Questions