ProcessingManager icon indicating copy to clipboard operation
ProcessingManager copied to clipboard

When selecting specific partition days it is only processing as per the incremental refreshing policy

Open GilbertQue opened this issue 4 years ago • 7 comments

Hi there, thanks for fixing the previous issue :)

What I now did was to configure the Partitions as shown below image

Now when I run the command line prompt, I watch it via SQL Profiler and I see it is not processing the partitions I selected. image

And when I review the partitions processed date I can see that the above partitions have not been processed. image

If you need anything further for me to help please let me know.

GilbertQue avatar Sep 30 '21 21:09 GilbertQue

This is due to the Incremental Refresh policy. This tool is not set up to override an Incremental Refresh policy. Would you share the details of the IR policy?

m-kovalsky avatar Oct 01 '21 07:10 m-kovalsky

Hi Michael, thanks for getting back to me.

Here are the details of the IR policy

image

If you need any more details please let me know.

GilbertQue avatar Oct 04 '21 22:10 GilbertQue

If you want it to ignore the Incremental Refresh policy, I believe you should set the table(s) as such:

image

m-kovalsky avatar Oct 05 '21 07:10 m-kovalsky

Thanks Michael, just to confirm the steps should be.

  1. Disable the "EnableRefreshPolicy"
  2. Run the processing of the partitions with your amazing script.
  3. Re-Enable the "EnableRefreshPolicy"

GilbertQue avatar Oct 05 '21 21:10 GilbertQue

Yes, try it out and let me know. You can also run steps 1&3 as scripts. If this works, I can add a functionality within the tool to allow an option for disabling incremental refresh just for a particular processing batch.

Step 1:

Model.Tables["TableName"].EnableRefreshPolicy = false;

Step 3

Model.Tables["TableName"].EnableRefreshPolicy = true;

m-kovalsky avatar Oct 06 '21 05:10 m-kovalsky

Hi Michael,

Thanks for the suggestion when I try and do this via Tabular editor to disable the refresh policy on a PPU database I get the following error shown below

image

GilbertQue avatar Oct 08 '21 05:10 GilbertQue

This issue is a bit outside the scope of this tool. The error message isn't too helpful but make sure to check out Tabular Editor's documentation on the subject. Otherwise you may want to open a support ticket with Microsoft.

https://docs.tabulareditor.com/te2/incremental-refresh.html

m-kovalsky avatar Nov 10 '21 08:11 m-kovalsky