CODEWITHSUNDEEP
c#azurehistorical-dbazure-timeseries-insights
SuperManu
SuperManu

Reputation: 107

Historical data ingestion and querying in Time Series Insights

We're evaluating Azure Time Series Insights (Preview) for ingesting historical IoT telemetry data. We use device timestamp instead of event enqueued timestamp as Timestamp property (Non-default behavior)

We've hit a snag around ingesting historical data (>2 year) old. TSI silently drops these messages. We want to understand what are the best practices for ingesting old data.

Similarly on the querying side, are the results returned based on TSI view (last 400 days) or can we query all existing parquet files (ie all the data that was ingested via Event hub howsoever old it may be) ?

We've tried ingesting new data and it appears on TSI dashboard. However we're not able to ingest old data since the timestamp is older. These messages are dropped.

We expect to ingest historical sensor data preserving device timestamps. We can pivot on event enqueued timestamp but this makes querying a problem. Looking for suggestions for resolving both the ingestion and querying part of historical data via Time Series Insights.

Upvotes: 3

Views: 513

Answers (0)

Related Questions