CODEWITHSUNDEEP
azurefilesharematillion
shiv.r
shiv.r

Reputation: 1

Matillion: Delete files from Azure Blob Storage Container and Windows Fileshare

I have a use case where I am Transferring XML files from Windows fileshare to Azure Blob Storage and then loading data to Snowflake Tables. I am using Matillion to achieve this.

The Windows Fileshare gets Zipped XML file which contains .xml and .xml.chk files. I am using Azure Blob Storage component of Matillion to Copy the .xml files to Snowflake table and have set Purge = True to delete them afterwards.

I need help in deleting the leftover .xml.chk files from Blob Storage Container. Also, once the data loading is complete, I would like to delete the zipped files from Windows Fileshare.

Thanks, Shivroopa

Upvotes: 0

Views: 626

Answers (1)

peterb
peterb

Reputation: 727

you can delete the files from blob storage using the matillion python script component (orchestration->scripting->Python script)

here is an example of python code to delete blob items and containers Delete Blob Example

I don't see a way to delete files on the windows machine from Matillion other than creating an API endpoint on the fileshare and calling the API from Matillion.

Upvotes: 1

Related Questions