Hope you are doing well. I am working on pibx file. The file takes data from 3 to 4 different tables of SQL database. The file also gets data from 3 to 4 CSV files. The size of csv files varies from a few hundred kilobytes to 5 MB. I used merge queries and attach desired columns from a couple of csv files into fact tables. I noticed that the performance of pibx file (slow down) after using merge queries. I found a training video from the portal to optimize the performance of pibx file. I followed the guidelines, size of the pibx file reduced from 35 MB to 16 MB.
However, I am still facing a performance issue. When I tried to refresh the data, it never refreshed the data. For some tables, it says that evaluating and for other tables it says waiting for other queries. I waited for a couple of hours but the same status was showing and it did not progress further.
By calling out a single member by name, you are likely preventing other forum members from responding to your post, and, as one of the purposes of this forum is to encourage community participation, this is discouraged.
That being said, for this issue, I’m guessing credentials or the network connection are the issue. Please confirm the correct credentials are being used to access the SQL database, and confirm network access/speed with your IT department, then try again. Loading tens of millions or hundreds of millions of rows from SQL to PBI is common and shouldn’t be the issue.
As @Greg mentioned above, please be reminded that while we encourage everyone’s participation in the forum, we don’t allow single calling out of a member to answer a question as this may discourage other users to help your inquiry.
To receive a resolution to your inquiry, please make sure that you provide all the necessary details on this thread.
We also noticed that no response has been received from you since July 2. If there won’t be any activity from your end in the coming days, we’ll be marking this thread as SOLVED.
Hi @leo_89 - Merge in Power Query is Memory and time consuming option. Avoid Merge as much as possible or pass it to Relational database using Query Folding.
First check if we can use Relationships in Data Model instead of doing Merge for so many tables.
Also, refer to below posts, these have good information on increasing Power Query and Merge performance.
Hi @Leo_89, did the response provided by @ankit help you solve your query? If not, how far did you get and what kind of help you need further? If yes, kindly mark as solution the answer that solved your query.
I hope that you are having a great experience using the Support Forum so far. Kindly take time to answer the Enterprise DNA Forum User Experience Survey, we hope you’ll give your insights on how we can further improve the Support forum. Thanks!
Hi @Leo_89, we’ve noticed that no response has been received from you since July 6th. We just want to check if you still need further help with this post? In case there won’t be any activity on it in the next few days, we’ll be tagging this post as Solved.
Hi @Leo_89, due to inactivity, a response on this post has been tagged as “Solution”. If you have a follow question or concern related to this topic, please remove the Solution tag first by clicking the three dots beside Reply and then untick the check box.