Append sales history files from Dataflow - “versioning “

Hello all. I am setting up a model to report on historical sales details and have created dataflows for each years data back to 2018 (about 1.5m records per year). So I have a dataflow for 2018, 2019, and 2020 through September. These are not scheduled to refresh just holding the data.

I have a “current” dataflow that refreshes sales details daily starting October 1st.

What I’d like to do is append the 3 historical tables to the “current” table each day. I’m struggling with the best approach. I’ve read several approaches but would like opinions.

Ideally the current table would refresh, then the 3 historical tables would append into the “master”.

Thanks for your help! Glenn

Thanks for posting your question @grjohnsonjr. To receive a resolution in a timely manner please make sure that you provide all the necessary details on this thread.

Here is a potential list of additional information to include in this thread; demo pbix file, images of the entire scenario you are dealing with, screenshot of the data model, details of how you want to visualize a result, and any other supporting links and details.

Including all of the above will likely enable a quick solution to your question.

Hi @grjohnsonjr, we’ve noticed that no response has been received from you since the 16th of October. We just want to check if you still need further help with this post? In case there won’t be any activity on it in the next few days, we’ll be tagging this post as Solved. If you have a follow question or concern related to this topic, please remove the Solution tag first by clicking the three dots beside Reply and then untick the checkbox. Thanks!