Carson Ip

[WIP][exporter/elasticsearch] Use exporterhelper/batchsender for reliability

1

**Description:** WIP. Blocked by: - batch by byte in https://github.com/open-telemetry/opentelemetry-collector/issues/8122 - batch by byte is an existing capability in elasticsearch exporter. Not supporting it will be a breaking change to...

[exporter/elasticsearch] Use batch sender exporter helper for reliability

3

### Component(s) exporter/elasticsearch ### Is your feature request related to a problem? Please describe. This is a way to fix the issue reported in https://github.com/open-telemetry/opentelemetry-collector-contrib/issues/30792. In case of a collector...

Test SNAPSHOT in smoketests

2

## Motivation/summary Support "latest" in lagacy-managed and legacy-standalone-major-managed by testing snapshots. ## Checklist - [ ] Update [CHANGELOG.asciidoc](https://github.com/elastic/apm-server/blob/main/CHANGELOG.asciidoc) - [ ] Documentation has been updated For functional changes, consider: -...

**Describe the bug** With batchsender, in-flight requests that are indefinitely blocking (due to e.g. retries) will block batchsender shutdown and the collector shutdown. Batchsender shutdown is blocked by https://github.com/open-telemetry/opentelemetry-collector/blob/main/exporter/exporterhelper/batch_sender.go#L220 which...

[exporterhelper] Awkwardness due to API between queue sender and batch sender

10

**Is your feature request related to a problem? Please describe.** Related to batch sender in #8122 Currently, queue sender and batch sender work together fine, but the config `sending_queue.num_consumers` and...

**Description:** Taking over from #33755 - Add data stream routing based on `data_stream.*` attributes - Refine metrics grouping to work with DS routing **Link to tracking Issue:** Closes #33755 Fixes...

**Description:** - **[chore][exporter/elasticsearch] Use RunParallel in bench** - **Measure docs/s and bulkReqs/s** - **Explicitly disable queue** This will be needed to measure performance of #32632

[exporter/elasticsearch] Make retry statuses configurable and default to 429 only

4

### Component(s) exporter/elasticsearch ### Is your feature request related to a problem? Please describe. Elasticsearch exporter retries on 500, 502, 503, 504, 429 by default, on both request level and...

Discovered by #13244 EA integration (see [code](https://github.com/elastic/integrations/tree/main/packages/elastic_agent/data_stream/apm_server_metrics)) is 1. using TSDS for apm-server metrics, i.e. synthetic source is used 2. apm-server metrics only contains a limited subset of metrics exposed...

As ES indexing moved from libbeat to docappender a long time ago, we no longer get "queue is full" log messages when apm-server internal buffer is full. - With docappender,...