CODEWITHSUNDEEP
powerbi
variable
variable

Reputation: 9684

How to perform incremental refresh based on modified date in Power BI?

Power BI Incremental refresh use case using the date created field is simple when there are no modifications or deletions to the data that is already loaded into the Power BI model.

I have a requirement where-in I need Incremental refresh with the ability to handle deletion and modifications.

For example: can I configure Incremental refresh on date modifed field, and suppose a record that was pulled in previous load is now modified in source thereby having a new Date modifed, then is the Incremental load able to delete the older record from the model when loading the new version of this row?

Similarly to handle situation where record is deleted from the source db?

If not supported by Power BI incremental refresh, then is there any way to handle such scenario in Power BI? Or I have to use the import full refresh mode only?

Upvotes: 2

Views: 2519

Answers (1)

David Browne - Microsoft
David Browne - Microsoft

Reputation: 89091

Power BI can detect which partitions have modified rows with the "Detect Data Changes" setting. Each partition will be queried to see if it contains any modified rows, and will be completely reloaded if it does.

Note you configure incremental refresh on some other date column, like SalesDate, and only use LastModifiedDate in change detection. If you try to use LastModifiedDate as the partition key, rows will migrate between partitions, and you'll get inconsistent data if the source and destination partitions are not refreshed at the same time.

Upvotes: 2

Related Questions