To Summarise the issue:
I am loading in fact data from 3 views (really needs to be 6 views)
Each view is circa 5million records
Each view contains around 20 surrogate (foreign) keys that are needed
I cant load in the data in Power BI desktop as the laptop is incapable of the volume of data (CPU etc just max out)
I had moved to Power BI Service. However I can not get more than three years into one dataflow without it failing (timeout generally). So in mu dataflow I have three queries that are diasabled and one Sales Query that appends all three sales queries (one Query that rules them all ).
I just cant see a way forward. The workspace is premium and I cant see any way forward apart from one dataflow per fact view and then join them in the data set.
Any suggestions? Having looked at the data I dont think Aggregations would help. The query to get the data is optimised, however runing it through SQL Server Management Studio it is not fast which I take as a sign the SQL box is bad or the network is bad.
Bit stuck now.