Category: Incremental Refresh

Incremental Refresh for Power BI datasets based on a numeric column (Year): Working with Parquet/Delta files in Azure Synapse Analytics

The most common scenario for setting up the out of the box incremental refresh in Power BI is to base it off of a datetime column; however, there are cases when you may want to set up incremental refresh based off of a column with a data type other than datetime. Examples are when you … Continue reading Incremental Refresh for Power BI datasets based on a numeric column (Year): Working with Parquet/Delta files in Azure Synapse Analytics

Exploring Automatic Partition Maintenance in Power BI datasets with Incremental Refresh, using EffectiveDate parameter

During one of my presentations on Incremental Refresh (IR) in Power BI, someone asked what happens during a Power BI automatic partition maintenance window when Power BI has an opportunity to merge smaller partitions into larger ones. Does Power BI use the data that is already imported into Power BI for the smaller partitions and … Continue reading Exploring Automatic Partition Maintenance in Power BI datasets with Incremental Refresh, using EffectiveDate parameter

How does the DirectQuery partition of a Hybrid table in Power BI get used in queries?

While I was tracing some Power BI datasets with Hybrid tables, I noticed that that the DirectQuery partition of a Hybrid table is used in all queries submitted to the Hybrid table, whether or not they are asking for data from that Direct Query partition. On first look, this does not look good because Power … Continue reading How does the DirectQuery partition of a Hybrid table in Power BI get used in queries?

A look at automatic partition maintenance by Power BI Service for datasets with Incremental Refresh

In this post, I am going to look at automatic partition maintenance by Power BI service for datasets with Incremental Refresh and focus on what happens to the partitions as time goes by. To do this, I am going to set up a couple of sample datasets with different Incremental Refresh (IR) policies with and … Continue reading A look at automatic partition maintenance by Power BI Service for datasets with Incremental Refresh