Materialized Lake View - Update!

A few months ago, I did a post on Materialized Lake Views, and said that it wasn't quite ready to fit in your normal data pipelines. You could only schedule the refresh with its own in built scheduler or hit the API to kick of a refresh. I had a lovely method to do an API refresh using an Fabric User Data Function, but the API didn't support a Service Principal or Workspace Identity, so I didn't end up using it sadly. However, as part of the June Fabric update, we now have in preview a 'Refresh Materialized Lake View' task, that we can use in our normal Fabric Data Pipelines, which makes orchestration issues in your data pipeline easier! This now moves it from a 'oh that's nice, but not really going to use it' to, I can use this in production now, and stream line my pipelines.

The best part of MLV's is that they only refresh items that need to be refreshed, by reading the delta table logs of the source tables. Which cuts out a load of 'has this changed, do I need to process it' logic.

See the details here Fabric - Materialized Lake Views in your pipelines

Thanks Microsoft