I have a question about combining folders.
I have 2 files 1 is called SAP MB51 Historical Data and 1 is called MB51 Download data.
The Historical data file is huge like 6 million rows as it contains all stock movements back to 2010 i use this to hold my yearly movements. I combined all the files in the folder to make one huge file no problem with that. This file never changes so i turned off the refresh option.
The download folder is the folder i update daily and contains the most recent transactions. i have combined this also no issues. This folder is refresh enabled.
Now my problem is i want to append my Download data to the bottom of my historical data. I can do this via 2 ways that i have tried and tested and neither is perfect and has an issue.
Append the data in query editor. This works OK and can be done however when the new append is loaded to the model whenever i add to my download data and do a refresh the historical file also refreshes and takes forever as youd expect which i dont want.
Union the data by loading the both files to the model disable refresh on the historic and leave enabled on the download file then create a union as a new table in the model
SAP MB51 = UNION(‘SAP MB51 Historical Data’,‘SAP MB51 Download Data’) This is OK and works fine and is fast because the refresh of Historic is disabled. However once you do this you do not get the ability to edit the data in the query editor as the new table i made doesn’t appear in the editor.
What i am looking for is a way to append the data in the query editor but not refresh the historical data. This will allow me to keep the flexibility of the query editor and also the speed of the refresh.
does anyone have any ideas?