I was wondering if this is possible with power BI
We have versioning of files in data lake. Version 1 , 2 up to 5 depend on the changes made in each fine.
A folder (version ) contains five files , the user can change any of the files and ingest the data through data factory in azure , the new files will now be a new version and there is a transformation that merge all files together to produce two output however, in the schema in data lake , a new column is created that holds the version.
Now, a user want the capability to query any version of file so they can see what has changed just like slowly changing dimensions in data warehouse
I am thinking in this direction, to duplicate the main dataset so I can use a parameter or filter on one version and the duplicate data set using another version but I don’t know if it is the right thing to do
However, they want the ability to see the differences between two files . I don’t know if it makes sense or is it do-able in power Bi or how would you tackle this.
Lastly, they want to be able to compare these files based on dates, for instant, file version 2 that was produced on the 1st of May against file version 2 created on 2nd of May… I assumed that i need to date calendar for this