Refresh multiple dataflows

I’ve setup a dataflow called Finance Main that aggregates data from a SharePoint folder, pulls in data from other dataflows, and then outputs a table called All.

Does anyone know if when the Finance Main dataflow is refreshed, if the other dependent dataflows (Facilities All and Finance Budget Sub2) are refreshed automatically? Currently, only the Finance Main dataflow has a scheduled refresh. From what I’ve seen so far, it does not appear as though the dependent dataflows are being refreshed automatically, only the main dataflow.

Here is a description for each table in the Finance Main dataflow:

  • ER&D: combine SharePoint data.
  • CoreOps: combine SharePoint data.
  • ERD_CoreOPs: combine ER&D and CoreOps tables.
  • Facilities All: data pulled in via external dataflow.
  • Finance Budget Sub2: data pulled in via external dataflow.
  • ALL: output table to Power BI which combines data from ERD_CoreOps, Facilities All, and Finance Budget Sub2.

Orchestration

Using dataflows in the same workspace allows straightforward orchestration. If you have dataflows A, B and C in a single workspace, and chaining like A > B > C, then if you refresh the source (A), the downstream entities also get refreshed. However, if you refresh C, then you’ll have to refresh others independently. Also, if you add a new data source in dataflow B (which is not included in A) that data will not be refreshed as a part of orchestration.

For scenarios where you want to chain items together that don’t fit the managed orchestration Power BI performs, or if you want to mix and match, you can use the APIs and/or use PowerAutomate. You can refer to the API documentation and the PowerShell script for programmatic refresh. There is a Power Automate connector that enables doing this without writing any code. You can see detailed samples, with specific walk-throughs for sequential refreshes.

Source:

You can also consider using PowerAutomate triggers for refreshing Dataflows in sequence.

Hello @EverythingZen ,

Did the response above help solve your query?

If not, can you let us know where you’re stuck and what additional assistance you need? If it did, please mark the solution that helped you.

Thank you

Hi @EverythingZen ,

Due to inactivity, a response on this post has been tagged as “Solution”. If you have a follow question or concern related to this topic, please remove the Solution tag first by clicking the three dots beside Reply and then untick the check box.

Thanks to @pranamg for contributing to this post.

We request you to kindly take time to answer the Enterprise DNA Forum User Experience Survey,

We hope you’ll give your insights on how we can further improve the Support forum. Thanks!