Hello community
Background - I would like to make a visualization based on column statistics for each column of data that originates from various data bases. My aim is to create training videos for the business on the importance of limiting for example free text entries in the various data bases to help lift data integrity for analysis.
As an example I would like to do a before and after of Valid, Error and Empty % and what good data can look like using the distinct and unique count results.
Question
In the query editor is there a way to capture the column statistics data into a table or would this be one of those manual tasks that I would need to enter the results into a spreadsheet and start the process from there?
Thank you community
Caroline
Hi @Cazvon,
Please review this article on how to extend on the Table.Profile function with an error count as example.
I hope this is helpful
Hi Melissa
Thank you so much for your prompt solution. Now I know the right terminology to use, not only was the You Tube link you provided helpful, I found a number of other YT videos that added to my learnings on this particular capability within Power BI.
I have now created a Table Profile of the non transformed data set and then another Table Profile of the transformed data and with the aid of the visualisations this was just what I wanted to demonstrate to the business - the importance of taking care when entering raw data into our databases. The visuals told the story with way more impact. My interest is in the ETL aspect of my data role, so now knowing how simple it is represent this part of the transformation process via visualisations has added another insight tool to my bag.
Thank you Melissa and thank you to Enterprise DNA forum for guiding me to this solution.
Caroline A
Great to hear this anwered your query, Caroline
Best of luck with your learning