opentelemetry-collector icon indicating copy to clipboard operation
opentelemetry-collector copied to clipboard

[scraperhelper] Allow scraper controller to be configured to run scrapers in parallel

Open dehaansa opened this issue 5 months ago • 2 comments
trafficstars

Description

When investigating an issue in contrib, it was discovered that the scraperhelper did not have a way to run scrapers in parallel and take advantage of the connection pool in the sqlqueryreceiver. This PR adds the ability to configure the scrapercontroller to run either unbounded goroutines to scrape in parallel or a configurable size worker pool for running scrapers in parallel.

Link to tracking issue

Fixes https://github.com/open-telemetry/opentelemetry-collector/issues/13113

Testing

Unit tests updated, but otherwise untested, posting here for initial review while I evaluate in context in contrib.

Documentation

No docs updated, as there's no existing docs for the package.

dehaansa avatar Jun 06 '25 04:06 dehaansa