Hello all. I am setting up a model to report on historical sales details and have created dataflows for each years data back to 2018 (about 1.5m records per year). So I have a dataflow for 2018, 2019, and 2020 through September. These are not scheduled to refresh just holding the data.
I have a “current” dataflow that refreshes sales details daily starting October 1st.
What I’d like to do is append the 3 historical tables to the “current” table each day. I’m struggling with the best approach. I’ve read several approaches but would like opinions.
Ideally the current table would refresh, then the 3 historical tables would append into the “master”.
Thanks for your help! Glenn