elasticsearch icon indicating copy to clipboard operation
elasticsearch copied to clipboard

[ILM] Avoid race condition between shrinking and ILM itself

Open nielsbauman opened this issue 8 months ago • 2 comments

In the ILM Shrink action, ILM performs (among others) the following steps: https://github.com/elastic/elasticsearch/blob/0ae817e5b60d3801cb02a2b7586573dd8ca72b1d/x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/ShrinkAction.java#L174-L176 The ShrinkStep copies the ILM policy name in the shrink request: https://github.com/elastic/elasticsearch/blob/0ae817e5b60d3801cb02a2b7586573dd8ca72b1d/x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/ShrinkStep.java#L85 However, when the allocation of the shards of the shrunken index takes "some" time (which is not unexpected for larger shards), which is what the second step waits for, ILM starts executing the policy on the shrunken index before the ILM execution state has been copied to that index (step three). This means ILM will start executing the policy from the beginning for the shrunken index, causing the WaitForRolloverReadyStep to fail here, instead of proceeding in the shrink action.

This is not necessarily harmful, it's just "noisy" - there is no data loss, it only produces some error logs and possibly a yellow health API status.

nielsbauman avatar May 30 '24 11:05 nielsbauman