CODEWITHSUNDEEP
jsonazureazure-data-factory
Tim F
Tim F

Reputation: 85

specify folder name during copy data task

I have a Copy Data task that extracts a set of compressed files from an "http file" source task.

This Copy Data task uses an Azure Blob Storage linked connection that writes to a specific folder: blob link picture

The issue I'm running into is that this connection seems to create another folder beneath the path that the connection writes to with a GUID that appears to generate off the RunID for the task.

How do I specify what folder I want it to go to instead of writing to a random GUID? I have another set of copy data tasks that's trying to look for the unzipped files in a folder but it can't find them each time because the GUID is always going to be different.

Thanks all.

Upvotes: 1

Views: 137

Answers (2)

Fang Liu
Fang Liu

Reputation: 2363

Please don't set copy behavior. Then it will use the zip file name as the folder name. enter image description here

Upvotes: 0

Jay Gong
Jay Gong

Reputation: 23792

Based on your description, I think you could configure folder path dymatically in your blob storage dataset.

For example:

"folderPath": {
          "value": "@concat('test1/',
                    formatDateTime(utcnow(),'yyyy'),'-', 
                    formatDateTime(utcnow(),'MM'),'-',
                    formatDateTime(utcnow(),'dd'))",
           "type": "Expression"
}

Then your files would be copied into 'yyyy-mm-dd' folder which could be found by your another activity.

enter image description here

Upvotes: 0

Related Questions