New Dimension not in Semantic Model

Power BI
1

Hi All,
Context: I’ve been developing a semantic model whose data source is a dataflow. I recently added a new dimension to the dataflow then, then, as usual, merged it with the fact table then refreshed the dataflow and the semantic model.

This issue: The new dimension isn’t appearing in the dataset. Its ID is in the fact table, but the table isn’t there. I ensured that the ‘enable load’ option is checked in the Dataflow.

My ask: Does anyone know what could be stopping the table from loading and/or be able to suggest how to ‘look beneath the covers’ to investigate the problem?

2

Hello @JulieCarignan!

I usually have this problem when I add new columns to fact tables.

Solution: You must delete the fact tables and add again the fact tables. Now you will see the new column in your model

I think that this situation is caused by change in the metadata of tables and table in the model is saved with that metadata but there is no way to update that metadata. If you go to tranform data and see the query that load that specific table you see the column but when you refresh the model you don’t see the new column.

3

Hi @JulieCarignan

Using DataMentor/EDNA AI tool built within the Enterprise DNA. I entered your problem, this what comes up:

Potential Issues and Solutions for Missing Dimension Table

Based on your description, here are several steps to help identify and resolve the issue:

1. Verify Dataflow Configuration

  • Check Relationships: Ensure the relationships between the dimension table and fact table are correctly defined.
  • Column References: Confirm that the column used for merging exists and is populated in both tables.

2. Dataflow Refresh

  • Incremental Refresh: If using incremental refresh, verify that it includes changes to the new dimension table.
  • Full Refresh: Sometimes, performing a full refresh can help fix the discrepancies in the dataset.

3. Data Load Options

  • Enable Load: Confirm that the ‘Enable Load’ option is enabled for all relevant tables within the dataflow.

4. Power BI Dataset

  • Refresh Dataset: After refreshing the dataflow, ensure the Power BI dataset is also refreshed.
  • Model Configuration: Check the configuration in the Power BI data model to ensure that the new dimension table is included and mapped properly.

5. Dataflow Dependencies

  • Dependencies and Order: Ensure there are no issues with dependencies and the load order within the dataflow, which might affect the final dataset.

Example Steps in Detail:

  1. Inspect Data Loading:
  • Go to the dataflow and check if the new dimension table loads correctly into the data preview.
  • Ensure there are no errors in the query editor related to this table.
  1. Confirm Load and Refresh:
  • Make sure the dataflow options have ‘Enable Load’ checked for the new dimension.
  • Perform a manual refresh of the entire dataflow.
  1. Review Power BI Data Model:
  • Go to the Power BI Model view and check if the new dimension table is listed.
  • Ensure relationships between the fact and dimension tables are correctly established.
  1. Refresh and Validate:
  • Refresh the Power BI dataset after confirming the dataflow is correctly updating.
  • Validate the data in Power BI reports ensuring the new dimension is now appearing.

If you follow these steps and the issue persists, you may need to:

  • Review any error messages displayed during the refresh.
  • Check the data quality and completeness in the new dimension table.
  • Consider consulting the dataflow’s refresh history logs for any additional insights.

By systematically approaching these checks, you should be able to identify where the issue might be and resolve it accordingly.

I hope this helps.

Thanks
Keith

4

Hi @brandon17parra and @Keith
Thank you for your assistance.

I figured out last evening what action is needed in this circumstance (when I develop a new table in a dataflow and need to get it into a related dataset): In the semantic model in PQ, I again have to ‘Get Data’ from the Dataflow and simply put a check in the checkbox for the additional tables I added.

That simple.

Thanks again,
Julie

1 Like
5

Hi @JulieCarignan - Great. Please mark this post as Solved.

Thanks
Ankit J