CODEWITHSUNDEEP
azureazure-blob-storagepowerbiazure-data-lakeazure-stream-analytics
Rody
Rody

Reputation: 2655

Why does Azure Stream Analytics outputs data to seperate files?

Why does Stream Analytics create separate files when using Azure Data Lake or Azure Blob Storage? Some times the stream runs for days in one file, while other times every day a couple of new files are made. It seems rather random?

I output the data to CSV, the query stays the same, and every now and then there is a new file generated.

I would prefer it to have one large CSV file, because I want to be able to run long-term statistics using Power BI on the data, but this seems impossible when it are all separate files with a seemingly random name.

Upvotes: 0

Views: 998

Answers (1)

Vignesh Chandramohan
Vignesh Chandramohan

Reputation: 1306

https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-outputs - this page has details about when a new file is created. In your case, it is most likely due to an internal restart.

Upvotes: 3

Related Questions