CODEWITHSUNDEEP
azureazure-data-factory
jnoguerm
jnoguerm

Reputation: 147

is it posible update row values from tables in Azure Data Factory?

I have a dataset in Data Factory, and I would like to know if is possible update row values using only data factory activities, without data flow, store procedures, queries...

Upvotes: 0

Views: 13709

Answers (4)

Kapil gupta
Kapil gupta

Reputation: 1

As mentioned in Above comment regarding ADF data flow, ADF data flow does not support on-permise sink or source, the sink & source should reside in Azure SQL or Azure Data lake or any other AZURE data services.

Upvotes: 0

PhilHibbs
PhilHibbs

Reputation: 943

This is now possible in Azure Data Factory, your Data flow should have an Alter Row stage, and the Sink has a drop-down where you can select the key column for doing updates.

enter image description here https://learn.microsoft.com/en-us/azure/data-factory/data-flow-alter-row

Upvotes: 0

WICIOwiec
WICIOwiec

Reputation: 151

There is a way to do update (and probably any other SQL statement) from Data Factory, it's a bit tacky though. The Loopup activity, can execute a set of statements in Query mode, ie: https://i.sstatic.net/khILx.png

The only condition is to end it with select, otherwise Lookup activity throws error.

This works for Azure SQL, PostgreSQL, and most likely for any other DB Data Factory can connect to.

Upvotes: 15

Leon Yue
Leon Yue

Reputation: 16401

Concepts:

Datasets:

Datasets represent data structures within the data stores, which simply point to or reference the data you want to use in your activities as inputs or outputs.

Now, a dataset is a named view of data that simply points or references the data you want to use in your activities as inputs and outputs. Datasets identify data within different data stores, such as tables, files, folders, and documents. For example, an Azure Blob dataset specifies the blob container and folder in Blob storage from which the activity should read the data.

Currently, according to my experience, it's impossible to update row values using only data factory activities. Azure Data Factory doesn't support this now.

Fore more details，please reference:

  1. Datasets
  2. Datasets and linked services in Azure Data Factory.

For example, when I use Copy Active, Data Factory doesn't provide my any ways to update the rows: enter image description here

Hope this helps.

Upvotes: 1

Related Questions