Power BI and very large data sets

We have a prospective customer who have very large data sets that increase significantly on a minute by minute basis getting information from 100,000+ sources.

Clearly we would have to use Direct Query linking to a SQL database on an Amazon AWS server but I just wonder if Power BI itself is the correct data analysis tool to be using in this particular environment.

Paul Boyes

Bumping this post for more visibility.

HI @PaulBoyes , while waiting for other members to jump in, I suggest using the forum search to discover if your query has been asked before by another member. Thanks!

Hi @PaulBoyes - If data is cleansed and Harmonized, meaning data is already integrated into 1-2 Facts tables from different sources instead of individual files from multiple Sources then yes Power BI can be considered as a Tool for reporting.

With Direct Query, there will be performance issues though with other limitations that are readily available on internet.

Thanks
Ankit J

Thank you so much for the very detailed answer @ankit :slight_smile:

Hello @PaulBoyes, if the inquiry was answered kindly mark the response that you think best helped you. Thank you so much.

Hi @PaulBoyes, due to inactivity, a response on this post has been tagged as “Solution”. If you have any concern related to this topic, you can reopen this thread.

Hi, many apologies but somehow replies ended up in the spam filter. Now sorted.

Thanks for the responses.

Paul