Close and Apply taking a long time

Power BI
1

Good morning.
I am working on some reports in Power BI that is taking a really long time saving the changes when I click ‘Close and Apply’ from the ‘Transform Data’ screen.

I was using Import mode for all the tables but the model got bigger (in terms of both number of records), and I’m currently in the process of migrating everything to Direct Query, hoping that that would make the process faster but the truth is, it has taken more than 2 hours to load 5 million records, and my model has about 50 million records total.

Am I doing something wrong, or it is just not feasible to consume that amount of records in Power BI? I have tried to build logic to only load a sample of N rows based on a parameter (locally on Power BI Desktop, see image attached), and then change the parameter value on the Server so the logic loads the whole table there when I refresh the dataset, but it doesn’t seem to be doing that and instead it’s loading the whole dataset locally which is not ideal.

These execution times are really not sustainable, and I don’t know what to do. I might be missing something because this doesn’t seem reasonable.

Thanks for the help.
Lilian.

image

2

@lplata,

Power BI can definitely handle data sets that size. I’ve seen demos where it handles over 1 billion records with adequate speed. Have you considered using incremental refresh?

https://www.youtube.com/watch?v=JsJWBr1_ktQ
https://www.youtube.com/watch?v=-pjmKI66iRQ

  • Brian
3

Hi @lplata, did the response provided by @BrianJ help you solve your query? If not, how far did you get and what kind of help you need further? If yes, kindly mark as solution the answer that solved your query. Thanks!

4

Hi @lplata, we’ve noticed that no response has been received from you since the 4th of May. We just want to check if you still need further help with this post? In case there won’t be any activity on it in the next few days, we’ll be tagging this post as Solved.