pinot icon indicating copy to clipboard operation
pinot copied to clipboard

Add nonLeaderCleanUp with tables parameters in PinotTaskGenerator

Open jackjlli opened this issue 7 months ago • 0 comments

This PR adds the nonLeaderCleanUp method with the list of table names as the parameter in the PinotTaskGenerator interface.

When the tasks are scheduled, the current controller may not always be the lead controller for the tables that were assigned to this controller (e.g. due to hardware uplift, downlift, maintenance), so there might be stale information like metrics that are left in this controller. Adding the nonLeaderCleanup override method in PinotTaskGenerator helps clean up the stale information.

jackjlli avatar Jun 28 '24 23:06 jackjlli