CODEWITHSUNDEEP
azure-data-factoryazure-data-explorer
user3434649
user3434649

Reputation: 11

Data Factory - Kusto - ingest cluster

I have a data factory pipeline that helps us clean our data sources for compliance (cosmos/blobs etc). I want to add kusto clean up as well to this pipeline. There is a purge option in kusto that helps to clean docs but this command can only be run on the Data Management endpoint (https://ingest-[YourClusterName].[Region].kusto.windows.net).

There is an ADF activity for data explorer commands but I cannot select the data management endpoint in the linked service. The auto populate doesn't include ingest cluster (only normal kusto cluster is present) and when entering it manually requires database and other info which is not present for data management endpoint. Is there a way we can select the data management endpoint for the command activity ? If not is there any other way to do this ?

Upvotes: 1

Views: 172

Answers (1)

Avnera
Avnera

Reputation: 7618

The purge command is intended for deleting specific rows to comply with compliance such as GDPR requirements.

I assume that when you say clean our data sources in Kusto, you mean dropping temp tables right? In that case, you can use the ".drop tables" command

Upvotes: 0

Related Questions