In this post, I explore various sharing options that Microsoft Fabric provides, from workspace level to item level to object level with SQL policy.
An introduction to the new Microsoft Fabric: Brings together the best of data integration, data warehousing, data science, data analytics and reporting, and more!
In this blog post, I show you how easy it is to start an Azure Synapse Analytics workspace (instance) and use its Serverless SQL Pool engine to analyze sample publicly available data. As you will read shortly, Azure Synapse Analytics provides many compute engines for different use cases. The easiest one to get started with … Continue reading Starting with Azure Synapse Analytics: Part 1: Create a Workspace and Analyze Sample Data with Serverless SQL Pool
The most common scenario for setting up the out of the box incremental refresh in Power BI is to base it off of a datetime column; however, there are cases when you may want to set up incremental refresh based off of a column with a data type other than datetime. Examples are when you … Continue reading Incremental Refresh for Power BI datasets based on a numeric column (Year): Working with Parquet/Delta files in Azure Synapse Analytics
During one of my presentations on Incremental Refresh (IR) in Power BI, someone asked what happens during a Power BI automatic partition maintenance window when Power BI has an opportunity to merge smaller partitions into larger ones. Does Power BI use the data that is already imported into Power BI for the smaller partitions and … Continue reading Exploring Automatic Partition Maintenance in Power BI datasets with Incremental Refresh, using EffectiveDate parameter
In this post, I am going to look at automatic partition maintenance by Power BI service for datasets with Incremental Refresh and focus on what happens to the partitions as time goes by. To do this, I am going to set up a couple of sample datasets with different Incremental Refresh (IR) policies with and … Continue reading A look at automatic partition maintenance by Power BI Service for datasets with Incremental Refresh
Here are my slides from my presentation at DataWeekender on 11/4/2023 are posted here. Beginners-Guide-to-Power-Apps-and-Power-BI-DataWeekender-CU6.5-2023Download https://www.dataweekender.com/schedule
Here are the slides for my Intro to Lakehouse in Microsoft fabric. If you are new to Microsoft Fabric, check out my post here for an intro. Introdcution-to-Lakehouse-in-Fabric-2023-09-11-Shabnam-Watson-2Download I will upload sample notebooks later today and update this post.
While I was tracing some Power BI datasets with Hybrid tables, I noticed that that the DirectQuery partition of a Hybrid table is used in all queries submitted to the Hybrid table, whether or not they are asking for data from that Direct Query partition. On first look, this does not look good because Power … Continue reading How does the DirectQuery partition of a Hybrid table in Power BI get used in queries?
I was trying to trace a dataset I had published to Power BI service using SQL Server Profiler and I was getting this error: Either the trace with the ID of 'MicrosoftProfilerTrace1667261566' does not exist in the server with the ID of 'autopremiumhostnorthcentralus001-081', or the user does not have permissions to access the object. For … Continue reading Error running a SQL Server Profiler trace for a Power BI dataset: Either the trace with the ID of ‘MicrosoftProfilerTrace1667261566’ does not exist …
Here is a short video that shows you how to set up incremental refresh with or without the hybrid option in Power BI. https://www.youtube.com/watch?v=CDJ3s4v7Fsg&t=458s