matomo icon indicating copy to clipboard operation
matomo copied to clipboard

Invalidations of reports command should allow to invalidate "All visits" only

Open tsteur opened this issue 3 years ago • 3 comments

Currently, when running ./console core:invalidate-report-data --sites=1 --dates=2022-10-01,2022-10-10, then all reports for the "All visits" segment and all other segments for that site are invalidated. This can cause a huge amount of invalidations which can put a lot of load onto a database and as a result it will take very long to reprocess this data.

It would be be great if we could specify something like --segment="" and then only the "All Visits" segment should be invalidated but not any other segments (unless specific other segments are also specified).

You can reproduce this by running ./console core:invalidate-report-data --sites=1 --dates=2022-10-01,2022-10-10 and then you will see invalidations in the archive_invalidations table for the done archive name and also for all the segments. Expected would be to only see archive invalidations for the done archive name.

tsteur avatar Nov 03 '22 23:11 tsteur

@mattab why is this tagged as 5.1.0, this doesn't sound like extremely high value to a large group of users. Am I missing something? Also I see it's been shifted to further milestones quite a few times, can I just shift it to 5.5.0?

Stan-vw avatar Sep 28 '23 03:09 Stan-vw

@Stan-vw This one is important for us on the Cloud to avoid getting paged when this command is used etc.

tsteur avatar Sep 28 '23 18:09 tsteur

Thanks for explaining Thomas, much appreciated 🙏

Stan-vw avatar Sep 29 '23 03:09 Stan-vw