CODEWITHSUNDEEP
azure-data-explorerkqlkusto-explorer
TamKap
TamKap

Reputation: 159

Increase azure data explorer query limit inside stored procedure

In azure data explorer DB I have defined procedure which should move aggregated data from one table into other DB table.
While running procedure following limit is being hit, E_RUNAWAY_QUERY _ message:

Aggregation over string column exceeded the memory budget of 8GB during evaluation

currently I can not decrease size of data transferred and wanted to use workaround option by increasing limits with set truncationmaxsize=... but when I try to include this order in stored procedure, sp fails during altering. Is it possible to use limit increasing commands (like set truncationmaxsize=1048576) inside stored procedures or not, if this is possible how?

Upvotes: 0

Views: 756

Answers (1)

Vamsi Bitra
Vamsi Bitra

Reputation: 2764

You can override those default memory limit consumption as per Limit on memory per iterator and Limit on memory per node.

The best way of approach would be splitting the result into multiple ones using (.set, .append, .set-or-append) you can refer query best practices and Ingest from query.

Upvotes: 0

Related Questions