Niels Bauman

Don't stop checking if the `HealthNode` persistent task is present

5

We assumed that once the `HealthNode` persistent task is registered, we won't need to register it again. However, when, for instance, we restore from a snapshot (including cluster state) that...

Add missing repository integrity docs for Health API

3

Follow up on https://github.com/elastic/elasticsearch/pull/104614 where I forgot to add the new details to the docs.

Extract `DataStreamIndices` from `DataStream` class

1

We were seeing more and more common fields between "regular" backing indices and failure store indices (i.e. `indices`, `rolloverOnWrite`, `autoShardingEvent`). To avoid having to duplicate these fields (and possibly any...

Collect APM metrics for failure stores

2

Collecting metrics for the number of failures, during both ingest and the bulk operation (regardless of whether failure store is enabled/applicable), and redirects to the failure store will give us...

Optimize usage calculation in ILM policies retrieval API

3

Optimize calculating the usage of ILM policies in the `GET _ilm/policy` and `GET _ilm/policy/` endpoints. I loaded some dummy data into my single-node locally-running ES cluster using the following script...

Capture additional info into failure documents

2

When a document fails in the ingest service and gets redirected to a failure store, we're adding some more information to aid debugging. This PR adds the `pipeline` (the pipeline...

Implement lazy rollover for failure stores

2

Allow marking failure stores for lazy rollover. When a failure occurs while trying to ingest a document, and it gets redirected to a failure store that is marked for lazy...

Transform Health API YAML test to Java REST test

3

This test failed occasionally due to the health node not having received the health info from all nodes yet, resulting in an "unknown" status. In a Java test, we do...

[CI] NodeShutdownReadinessIT testShutdownReadinessService failing

2

**Build scan:** https://gradle-enterprise.elastic.co/s/zcc5olyxhgh3k/tests/:x-pack:plugin:shutdown:internalClusterTest/org.elasticsearch.xpack.shutdown.NodeShutdownReadinessIT/testShutdownReadinessService **Reproduction line:** ``` ./gradlew ':x-pack:plugin:shutdown:internalClusterTest' --tests "org.elasticsearch.xpack.shutdown.NodeShutdownReadinessIT.testShutdownReadinessService" -Dtests.seed=B1930FEC7B225CE6 -Dtests.locale=pl -Dtests.timezone=Europe/Dublin -Druntime.java=22 ``` **Applicable branches:** main **Reproduces locally?:** Didn't try **Failure history:** [Failure dashboard for `org.elasticsearch.xpack.shutdown.NodeShutdownReadinessIT#testShutdownReadinessService`](https://es-delivery-stats.elastic.dev/app/dashboards#/view/dcec9e60-72ac-11ee-8f39-55975ded9e63?_g=(refreshInterval:(pause:!t,value:60000),time:(from:now-7d%2Fd,to:now))&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('testShutdownReadinessService'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.xpack.shutdown.NodeShutdownReadinessIT'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium))))) **Failure excerpt:**...

[CI] ClusterSettingsIT testUserMetadata failing

5

Assigning to Distributed team due to `"internal:cluster/coordination/commit_state"` pending task. **Build scan:** https://gradle-enterprise.elastic.co/s/4cpjhyiuzmbjm/tests/:server:internalClusterTest/org.elasticsearch.cluster.settings.ClusterSettingsIT/testUserMetadata **Reproduction line:** ``` gradlew ':server:internalClusterTest' --tests "org.elasticsearch.cluster.settings.ClusterSettingsIT.testUserMetadata" -Dtests.seed=FC0849ED15EE831B -Dtests.locale=es-PE -Dtests.timezone=Africa/Juba -Druntime.java=22 ``` **Applicable branches:** main **Reproduces locally?:** Didn't...